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CHAPTER  I 


INTRODUCTION 

The  American  public  is  taking  an  ever-increasing 
interest  in  the  manner  in  which  the  Federal  Government 
spends  public  funds.  There  are  a  number  of  reasons  for 
this  trend  towards  greater  public  fiscal  awareness.  Rising 
inflation  and  the  continuing  decrease  in  the  buying  power 
of  the  dollar  have  focused  people's  attention  on  the 
increased  taxes  needed  to  carry  out  the  numerous  func¬ 
tions  of  government.  Also  the  widespread  publicity  given 
recent  discoveries  of  scandal  within  government  purchasing 
agencies  has  fueled  public  mistrust  of  big  government. 

Each  year,  when  the  budget  is  presented  to 
Congress,  considerable  attention  is  directed  towards  that 
portion  to  be  allocated  to  the  Department  of  Defense  (DOD), 
a  portion  which  has  been  substantially  reduced  in  real 
terms  over  the  past  several  years  (12i273).  This  reduction 
in  the  DOD  budget,  combined  with  higher  prices  for  military 
hardware,  necessitates  increased  emphasis  on  improved 
purchasing  techniques  and  procedures. 

Learning  or  experience  curves  are  one  method  used 
by  the  DOD  to  estimate  direct  labor  hours  required  in 
production  (13i2D25).  The  learning  curve  was  developed 


from  an  observed  relationship  whereas  when  the  number  of  units 
produced  doubles,  the  unit  cost  (in  manhours)  decreases  by  a 
constant  percentage.  The  theory  was  developed  with  some 
assumptions  about  the  industry  to  which  it  could  be  applied. 
These  assumptions  arei 

(1)  The  production  item  should  be  sizeable  and 
complex  and  should  require  a  large  amount  of  direct  labor. 

(2)  The  majority  of  assembly  operations  should 
not  be  mechanized  or  machine-paced. 

(3)  Learning  curves  applied  from  past  experience 
should  be  adjusted  for  any  differences  in  items,  process, 
or  other  aspects  cf  production. 

(4)  The  production  process  should  be  a  continuous 
one  and  the  item  and  product  changes  kept  to  a  minimum. 

(5)  Historical  data  should  be  available  to  compute 
the  curve,  since  estimated  data  has  low  reliability. 

(6)  There  should  be  no  external  production  rate 
changes  (2i231). 

This  final  assumption  about  production  rate  changes  has  been 
the  subject  of  considerable  study. 

LIMITING  THE  PROBLEM 

The  focus  of  much  previous  research  has  been  to  seek 
a  variation  to  the  basic  learning  curve  model  which  takes 
production  rate  changes  into  consideration.  These  studies 


and  their  findings  will  be  discussed  in  the  next  chapter. 

A  key  result  of  the  studies  was  a  model  developed  for  air¬ 
frame  production  by  Smith  (11)  which  improved  the  basic 
learning  curve  model  through  the  addition  of  a  production 
rate  variable. 

This  model  should  be  applicable  to  industries  other 
than  the  airframe  manufacturing  industry,  since  the  basic 
learning  curve,  on  which  it  is  based,  is  applicable  to 
these  other  industries.  This  research  applied  Smith's 
model  to  aircraft  engine  production  data  to  see  if  the 
basic  theory  could  be  extended  to  aircraft  engine  produc¬ 
tion. 

THE  RESEARCH  PROBLEM  STATEMENT 

The  effect  of  changes  in  the  production  rate  on 
direct  labor  requirements  for  aircraft  engine  production 
is  not  known. 

RESEARCH  OBJECTIVES 

The  primary  objectives  of  this  research  are  (1) 
to  determine  if  changes  in  production  rate  affect  total 
direct  labor  requirements  per  engine,  and  (2)  to  determine 
how  the  production  rate  model  compares  with  the  basic 
learning  curve  model  as  a  j  Mictor  of  direct  labor 
requirements  for  aircraft  ei.  ie  production.  The 
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accomplishment  of  these  objectives  will  determine  the  appli¬ 
cability  to  aircraft  engine  production  of  the  approach  used 
by  Smith  to  estimate  direct  labor  hour  requirements  in  air¬ 
frame  production. 

RESEARCH  HYPOTHESES 

The  hypotheses  to  be  tested  in  this  research  are 
that  the  production  rate  explains  a  significant  portion  of 
the  variation  in  direct  labor  hour  requirements  for  air¬ 
craft  engine  production,  and  that  the  production  rate  model 
is  a  better  predictor  of  direct  labor  hour  requirements  than 
is  the  reduced  model. 

JUSTIFICATION 

In  a  major  DOD  system  acquisition  program,  the 
initial  contract  negotiations  set  up  a  tentative  monthly 
schedule  for  the  life  of  the  program.  The  formal  contract 
agreements  between  the  contractor  and  the  Department  of 
Defense  are  usually  only  for  a  period  of  one  year.  Sub¬ 
sequent  delivery  requirements  depend  on  the  funding  appro¬ 
priated  for  the  project  by  Congress  (11«2). 

The  basic  learning  curve  is  currently  used  to 
determine  the  direct  labor  hour  portion  of  the  new  cost 
estimates  used  during  annual  negotiations.  If  the  pro¬ 
duction  rate  model  proves  to  be  a  better  predictor  of 
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labor  hours  in  aircraft  engine  production,  it  would  be  a 
valuable  tool  in  this  cost  estimating  process. 

SUMMARY 

The  topic  has  thus  been  narrowed  from  the  general 
to  the  specifics  from  federal  expenditures,  to  DOD  expen¬ 
ditures,  to  the  use  of  the  learning  curve  in  DOD  cost  esti¬ 
mating,  and  finally  to  incorporating  production  rate  changes 
into  the  learning  curve  model  for  improved  accuracy.  The 
application  of  Smith's  production  rate  model  to  aircraft 
engine  production,  which  has  been  identified  as  the  focus 
of  this  research,  could  be  of  substantial  benefit  to  the 
DOD  acquisition  process.  The  theory  of  the  basic  learning 
curve  and  the  historical  development  of  the  production 
rate  model  will  be  presented  in  the  next  chapter. 
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CHAPTER  II 

A  HISTORY  OF  THE  USE  OF  THE  LEARNING  CURVE 
IN  ESTIMATING  LABOR  HOUR  REQUIREMENTS 

The  learning  curve  has  been  used  extensively  in 
the  aircraft  industry  during  the  last  30  years  to  assist 
in  cost  estimating  for  major  DOD  weapons  acquisition  pro¬ 
grams.  Since  the  introduction  of  the  basic  learning  curve 
model,  a  number  of  variations  have  been  developed  in  an 
attempt  to  achieve  a  greater  accuracy  in  predicting  actual 
cost  figures.  The  most  promising  of  these  variations  de¬ 
veloped  in  previous  research  has  been  the  production  rate 
model.  Smith's  study  in  this  area  resulted  in  a  model 
which  proved  to  be  an  effective  predictor  for  airframe 
direct  labor  costs?  replication  of  this  model  as  applied 
to  aircraft  engines  was  the  focus  of  this  research. 

BEGINNINGS 

T.  P.  Wright's  1936  article  on  the  application  of 
the  learning  curve  to  aircraft  manufacturing  cost  estima¬ 
tion  is  widely  regarded  as  the  initial  substantive  effort 
in  mathematically  modeling  the  learning  phenomenon  for 
aircraft  manufacturing  (13«2D26).  Increased  rates  of 
aircraft  production  at  the  onset  of  World  War  II  drew  US 
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Government  attention  to  the  concept  of  improved  output  with 
constant  facilities;  consequently,  the  Government  sponsored 
a  Stanford  Research  Institute  statistical  analysis  of  World 
War  II  airframe  direct  labor  data.  The  Stanford  study  con¬ 
firmed  the  learning  curve  effect  on  World  War  II  production, 
and  demonstrated  the  value  of  a  learning  curve  model  for 
use  in  cost  analysis  (13*2D26-7)*  Numerous  subsequent 
studies  concentrated  on  validation  and  refinement  of  the 
basic  model  to  achieve  better  estimates  of  future  projected 
direct  labor  costs.  Specific  foci  of  various  studies  in¬ 
cluded  the  addition  of  more  coefficients  to  the  basic  linear 
model  and  analysis  of  the  reliability  of  the  basic  learning 

9 

curve  model;  these  investigations  will  be  addressed  later 
in  this  chapter.  All  studies  dealt  with  some  variation  of 
the  standard  learning  curve  model. 

STANDARD  LEARNING  CURVE  MODEL 

It  can  be  intuitively  discerned  that  for  labor 
production  processes  which  are  repetitious,  each  succes¬ 
sive  equivalent  unit  of  production  will  require  fewer 
direct  manhours,  and  that  the  manhours  required  will  de¬ 
crease  at  a  decreasing  rate.  This  phenomenon,  known  as  the 
learning  or  experience  curve,  has  two  basic  variations. 

The  variation  validated  by  the  Stanford  study  is  known 
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as  the  "unit  curve"  or  "Boeing"  theory  (13i2D28j  10i273), 
and  can  be  expressed  mathematically  by  the  formula i 

Y  =  AXB 

where  t 

Y  represents  the  direct  labor  hours  for  the 
"xth"  unit? 

X  represents  the  total  number  of  units 
manufactured  in  the  process ; 

A  represents  the  number  of  labor  hours  to  produce 
the  first  unit  manufactured  in  the  process}  and 
B  represents  the  slope  parameter  or  a  function 
of  the  improvement  rate. 

The  slope  of  the  curve  can  be  expressed  as  a  percentage, 
which  is  the  ratio  between  the  per  unit  cost  at  any  unit 
and  the  percent  cost  at  double  that  number  of  units  (2il99). 
The  "cumulative  average"  or  "Northrop”  variation  (described 
by  Wright  in  his  1936  article)  measures  the  average  cost 
for  x  units  rather  than  cost  for  the  xth  unit.  Its  mathe¬ 
matical  form  is i 

Y  =  AXB 

"where  Y  is  the  cumulative  average  cost  of  all  production 
up  to  and  including  the  xth  unit.  The  other  oarameters 
are  the  same  as  for  the  unit  curve  theory  (/l3«2D2 2/." 

While  the  Boeing  and  Northrop  models  can  be  manipulated  in 
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the  same  manner,  the  user  should  be  aware  of  the  difference 
between  the  unit  cost  and  cumulative  average  unit  cost  mea¬ 
sured  by  these  respective  models.  The  unit  learning  curve 
will  be  the  model  used  for  the  rest  of  this  paper. 

HISTORY  OF  THE  DEVELOPMENT  OF  THE 
PRODUCTION  RATE  MODEL 

Robert  Blair  Ilderton.  Ilderton  compiled  data  on  methods 
of  fitting  learning  curves  to  production  data  using  the 
assumptions  and  techniques  of  regression  analysis.  He 
was  chiefly  concerned  with  computer  programs  written  to 
accomplish  this.  Also,  suggestions  were  made  on  possible 
improvements  to  the  learning  curve  model .  One  suggested 
improvement  was  to  consider  more  factors  than  in  the  basic 
model.  The  first  factor  listed  by  Ilderton  was  that  of 
consideration  of  the  effect  of  different  levels  of  produc¬ 
tion  on  labor  requirements  (5*6 9-71). 

Gordon  J.  Johnson.  Johnson  predicted  labor  requirements 
for  rocket  motors  using  an  additive  form  model  which  con¬ 
sidered  both  the  rate  effect  and  the  learning  effect.  The 

7 

model  he  used  was  y  =  A  +  BX^  +  CX2  where: 

y  represents  direct  labor  hours  per  month; 

X^  represents  production  rate  in  equivalent 
units  per  month; 
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X£  represents  cumulative  units  produced  as  of  the 
end  of  each  month;  and 

A.B.C  and  Z  are  model  parameters. 

Johnson  regressed  this  model  against  four  sets  of 
rocket  motor  data.  His  results  are  shown  in  Table  1.  As 
depicted  in  the  table,  Johnson  had  good  results  (high  R2) 
with  data  sets  1  and  4,  fair  results  with  data  set  2  and 
poor  results  with  data  set  3.  Johnson  explained  data  set 
3's  poor  results  as  being  due  to  an  inadequate  accounting 
system  used  by  the  manufacturer.  He  concluded  that  the  pro¬ 
duction  rate  is  a  significant  determinant  of  direct  labor 
requirements  (6:2  5-^1 ) • 

Joseph  Noah.  Smith  reported  on  research  performed  by  Noah, 
with  emphasis  on  his  findings  on  direct  labor  hours  (11:31- 
35).  Noah  analyzed  cost  data  to  find  the  effect  of  produc¬ 
tion  rate  on  airframe  costs.  His  model  for  the  data  was 
y  =  eA,X®:X2*X°  where: 

y  represents  average  direct  labor  hours  per 
pound  of  airframe  for  each  airframe  lot; 

e  is  the  base  of  the  natural  logarithm; 

X^  represents  the  cumulative  volume  in  pounds  of 
aircraft  produced  by  the  midpoint  of  each 
airframe  lot; 

Xg  represents  the  production  rate  in  average 
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TABLE  1 

SUMMARY  OF  JOHNSON'S  REG 


Regression  Variables 


Labor  Hours  vs  Cumulative  Units 

[Cumulative  Units 
&  Production  Rate 


Source :  (6t 34 ) . 
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ANALYSIS 


===  I 

Coefficients  of  2 
Determination  (R  j 

Data  Set 

12  3  4 

•753  -395  .00678  .763 

•932  .808  .308  .927 


pounds  of  airframe  delivered  per  month  for 
the  entire  period? 

represents  the  annual  volume  of  aircraft  in 
airframe  pounds;  and 
A,B,C  and  D  are  model  parameters. 

Noah  averaged  the  estimated  regression  coefficients 
from  two  sets  of  data,  one  on  the  F-4  and  the  other  on  the 
A-7,  and  tried  to  develop  a  generalized  cost  model.  Smith 
felt  that  this  approach  was  questionable  and  that  the  model 
needed  to  be  tested  on  additional  aircraft  programs  to  deter¬ 
mine  if  it  did  actually  serve  as  an  accurate  predictor.  Also, 
Smith  stated  that  while  the  lot  average  airframe  delivery  rate 
was  a  practical  representation  of  the  production  rate,  the 
average  delivery  rate  variable  appeared  to  lag  the  actual 
expenditure  of  hours  required  to  produce  the  airframes 
delivered  (11*31-35) • 

Joseph  A.  Orsini.  Orsini  (9*57-80)  investigated  the  appli¬ 
cability  of  Johnson's  three-dimensional  model  to  airframe 
production  by  performing  regression  analysis  on  the  direct 
labor  hours  associated  with  the  C-141  program.  He  established 
24  quarterly  production  periods,  and  calculated  the  equivalent 
units  of  production  and  associated  labor  hours  for  each 
period.  The  C-141  production  run  experienced  a  typical 
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quantity  rate  fluctuation  whereby  the  production  rate  rose 
gradually  to  a  maximum  output,  then  tapered  off  toward  the 
end  of  the  program.  Orsini  first  regressed  the  data  with 
the  standard  unit  learning  curve  model,  employing  cumulative 
units  as  the  single  independent  variable.  He  next  applied 
Johnson's  three-dimensional  model  to  determine  the  effect 
of  the  addition  of  a  second  independent  variable,  then 
introduced  a  multiplicative  or  log-linear  three-dimensional 
model  which  is  stated  in  its  curvilinear  form  as  follows* 


where : 

Y  represents  the  direct  labor  hours  per  quarter; 

X1  represents  the  number  of  units  produced  per 
quarter; 

X2  represents  the  cumulative  number  of  units 
produced  as  of  the  end  of  each  quarter; 

Bq »  B^,  and  are  model  parameters,  and  e  is 
the  base  of  natural  logarithms. 

Orsini  found  that  the  coefficients  of  correlation  and  deter¬ 
mination  decreased  in  every  case  where  the  production  rate 
independent  variable  was  excluded,  which  implied  that  "the 
three-dimensional  cost  models  provide  a  better  fit  for  the 
sample  data  analyzed  /9«70 J."  His  first  conclusion  was 
therefore  that  the  inclusion  of  the  production  rate  as  a 
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second  independent  variable  significantly  improved  the  ex¬ 
planatory  ability  of  both  the  additive  and  the  multiplicative 
models.  His  second  conclusion  was  that  the  multiplicative 
models  performed  better  as  predictors  than  the  additive 
models  "because  they  eliminate  the  requirement  of  estimating 
the  additional  parameter  Z  /_ 9:71 


Larry  L.  Smith.  Smith  directed  his  research  toward  the  prob¬ 
lem  that  there  was  no  generally  accepted  technique  for  esti¬ 
mating  airframe  costs  which  systematically  employed  a  pro¬ 
duction  rate  variable.  He  sought  to  develop  a  generalized 
approach  to  building  cost  models ,  where  "model  parameters 
can  be  tailored  to  a  continuing  airframe  production  pro¬ 
gram  ZIls567."  These  tailored  models  could  then  serve  as 
predictors  of  direct  labor  requirements  of  additional  air¬ 
frames  .  Previous  studies  had  suggested  that  the  production 
rate  was  an  important  independent  variable  in  the  formation 
of  an  effective  predictor,  and  Smith's  initial  tests  had 
provided  support  for  this  hypothesis,  so  he  developed  the 


following  modified  version  of  Orsini's  multiplicative  model*. 


Bi  Bo 

Yi  *  B0  '  V  Vi 


10ei 


where  j 


represents  the  unit  average  direct  labor  hours 
required  to  output  each  pound  of  airframe 
in  lot  i; 
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Xn  represents  the  cumulative  output  of  all  air¬ 
frames  through  lot  ij 

X2i  represents  the  production  rate  of  the  air¬ 
frames  in  lot  ij 

represents  the  variation  which  is  left  unex¬ 
plained  by  the  variables  in  the  model;  and 
Bq,  B1>  and  B2  are  model  parameters  (11«43). 

To  facilitate  regression  analysis,  Smith  transformed  the 
model  by  extracting  the  common  logarithm  of  each  term,  which 
resulted  in  the  form  Log  Y^Log  B0+B1  Log  X1^+B2  Log  X2i+  e^, 
with  the  model  thus  linear  in  each  term  (11»19;  3 *45).  He 
called  his  three-dimensional  model  the  "full"  model,  and 

compared  its  performance  with  that  of  the  two-dimensional 

Bi  e, 

multiplicative  model,  Y^  =  BQ  ’  X^  *  10  1,  which  he  called 
the  "reduced"  model  (11  j69?  3*19)- 

Smith  compiled  direct  labor  hour  statistics  on  the 
production  of  F-4,  KC-135»  and  F-102  airframes,  and  formed 
16  different  sets  of  data  for  analysis,  with  each  data  set 
containing  characteristics  as  indicated  in  Table  2.  He 
used  two  different  proxies  for  the  production  rate  variable 
in  his  three-dimensional  model  (Ilil3;  3*19).  The  first 
proxy,  the  "lot  average  manufacturing  rate",  was  defined 
as  the  number  of  airframes  in  a  lot  divided  by  the  lot 
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SMITH’S  REGRESSION  MODEL  SUMMARY 
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Sources  (11, 71-143), 


time  span,  where  lot  time  span  was  the  time  span  between 
the  release  date  of  the  first  airframe  in  the  lot  and  the 
completion  date  of  the  last  airframe  in  the  lot.  The  second 
production  rate  proxy,  the  "lot  delivery  rate",  was  defined 
as  the  actual  monthly  airframe  acceptance  rate. 

Extensive  statistical  analysis  was  performed  on  the 
16  data  groups,  including  regression  analysis  for  all  groups, 
and  predictive  ability  tests  for  most.  The  results  are 
tabulated  in  Tables  2  and  3*  Predictive  ability  tests  were 
not  performed  on  data  groups  (test  situation  numbers)  13 
through  16  because  each  group  had  only  seven  observations , 
which  were  considered  insufficient  to  achieve  meaningful 
results  (11s 131).  The  accuracy  of  the  predictive  ability 
of  each  model  was  tested  by  omitting  a  portion  of  the  down¬ 
stream  data  and  then  regressing  the  model  against  the  remain¬ 
ing  data  to  predict  what  the  omitted  values  should  be.  A 
comparison  of  the  omitted  and  predicted  values  provided  a 
subjective  measure  of  predictive  ability  (II1561  3«20). 

Smith  drew  the  following  conclusions  from  the 
results  of  his  tests  1 

1.  The  production  rate  variable  contributed 

importantly  to  the  explanatory  ability  of  the  model,  as 

2 

can  be  seen  by  a  comparison  of  the  full  and  reduced  R 
statistics  in  Table  2. 
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TABLE  3 


SUMMARY  OF  SMITH'S  PREDICTIVE  ABILITY  TESTS 


Test 

Situation  # 

Percent  Deviation 

of  Predicted  Value 

Full  Model 

Reduced  Model 

1 

-2.63 

14.50 

2 

2.19 

13.60 

3 

Not  Reported 

13.60 

4 

1-75 

5.26 

5 

3-07 

5.26 

6 

-7-84 

Not  Reported 

7 

"a" 

Not  Reported 

8 

"b" 

1.07 

9 

"b" 

1 .07 

10 

-1 .05 

5.61 

11 

3-51 

Not  Reported 

12 

2.20 

-3.30 

Smith  reported  the  deviation  was  larger  than  that 
for  test  6,  but  did  not  indicate  the  specific  value  (lit 96). 

bSmith  reported  the  deviations  were  smaller  than 
those  of  the  respective  reduced  models,  but  did  not  indicate 
the  specific  values  (lltlOl). 


Source t  (11:71-125) 
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2.  The  manufacturing  rate  proxy  performed  slightly 
better  than  did  the  delivery  rate  proxy  for  the  production 
rate  variable,  and  both  proxies  proved  to  be  important 
contributors  to  the  explanatory  power  of  the  model. 

3*  The  production  rate  variable  stabilized  and 
improved  the  predictive  ability  of  the  cost  model  for  the 
F-4  and  F-102  aircraft  programs,  and  results  were  inconclu¬ 
sive  with  KC-135  program  data  ( 11 1 142-146}  3 t 21-24). 

Congleton  and  Kinton.  Replicating  Smith's  approach, 

Congleton  and  Kinton  evaluated  historical  data  collected 
from  the  T-38/F-5  program.  Their  objectives  were  to  identify 
the  impact  of  externally  caused  production  rate  changes  on 
direct  labor  requirements  in  an  ongoing  production  program, 
and  to  attempt  to  validate  Smith's  model  (3*26-27).  The 
full  and  reduced  models  used  in  the  testing  and  the  research 
hypotheses  tested  were  identical  to  Smith's.  Their  research 
effort  validated  the  predictive  ability  of  Smith's  model  and 
provided  the  following  conclusions: 

1.  A  negative  correlation  exists  between  pro¬ 
duction  rate  and  direct  labor  requirements.  This  con- 

2 

elusion  was  based  on  the  fact  that  the  R  coefficients 
were  negative  in  every  situation  tested,  which  indicated 
that  "if  production  rate  is  increased,  the  required  labor 


hours  per  pound  of  airframe  will  decrease  ^3»9l7»" 

2.  Both  production  rate  proxies  were  important 
contributors  to  the  full  model's  predictive  ability. 

3.  The  full  model  fit  the  data  more  closely  than 

did  the  reduced  model.  Support  for  this  conclusion  was 

2 

based  on  the  fact  that  the  actual  R  value  was  higher  for 

the  full  model  in  29  of  30  comparisons  with  the  reduced 

model,  and  the  single  contrary  result  was  at  less  than  1 

2 

percent  difference  in  R  values. 

4.  The  predictive  ability  of  the  full  model  was 
judged  to  be  better  and  more  stable  than  that  of  the 
reduced  model,  although  the  results  on  which  this  con¬ 
clusion  was  based  were  not  as  strongly  supportive  as 
Smith's  (3s 91-5) • 

In  summation,  then,  Congleton  and  Kinton  succeeded  in 
closely  replicating  Smith's  results,  and  further  vali¬ 
dated  his  conclusions. 

DISSENTING  OPINIONS 

In  the  study  of  the  effect  of  the  production  rate 
on  direct  labor  hours ,  all  researchers  were  not  in  agree¬ 
ment.  Although  most  studies  found  the  production  rate  to 
be  an  important  factor,  there  were  some  dissenting  opinions 
and  conclusions.  Two  of  these  studies  were  the  study 
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conducted  by  Large,  Hoffmayer,  and  Kontrovich  and  the  study 
performed  by  Alchian  and  Allen. 

Large,  Hoffmayer  and  Kontrovich.  Large,  Hoffmayer  and 
Kontrovich  performed  an  investigation  concerning  the  effect 
of  production  rate  on  the  cost  of  some  types  of  military 
hardware.  The  study  was  sponsored  by  the  Office  of  the 
Secretary  of  Defense  in  the  hope  that  an  estimating  model 
could  be  developed  (7 *^9-50). 

This  study  assumed  that  production  rate  and  unit 
cost  would  vary  inversely.  In  conducting  the  study,  the 
authors  examined  data  pertaining  mainly  to  aircraft  pro¬ 
duction  with  a  brief  look  at  missiles  and  aircraft  engines. 
The  researchers  were  concerned  with  four  major  cost  ele¬ 
ments  for  aircraft  frames!  manufacturing  labor,  manufac¬ 
turing  materials,  tooling,  and  engineering.  The  research 
on  missiles  and  engines  was  briefer  but  also  looked  at  the 
different  aspects  of  costs  (7*50) . 

Large,  Hoffmayer  and  Kontrovich  concluded  that  the 
effect  of  production  rate  on  manufacturing  labor,  manufac¬ 
turing  materials,  tooling  and  engineering  could  not  be  pre¬ 
dicted  with  confidence,  and  that  the  worth  of  including 
this  factor  in  the  model  seemed  questionable  during  the 
early  development  process  of  a  major  acquisition.  They 
stated  that  each  case  needed  to  be  examined  separately 


to  determine  the  specific  manner  in  which  production  changes 
occurred.  This  was  considered  necessary  because  the  way  a 
rate  was  achieved  and  the  time  allowed  to  achieve  the  new 
rate  were  felt  to  have  as  much  or  more  importance  than  the 
magnitude  of  the  rate  change  .  The  team  concluded  that  a 
similar  model  could  be  used  during  a  contract's  production 
planning  phase,  but  that  a  separate  study  would  be  needed  to 
develop  this  model  (7«51)* 

Dreyfuss  and  Large .  In  a  report  by  the  Rand  Corporation 
done  for  the  Air  Force  in  March  1978,  Large,  working  with 
another  researcher,  Dreyfuss,  arrived  at  conclusions  about 
the  production  rate  effect  which  contradicted  those  of  his 
earlier  work.  The  subject  of  this  report  was  the  effect  of 
extended  low-rate  production  of  airframes.  In  concluding 
about  the  effect  of  production  rate  on  costs,  Dreyfuss  and 
Large  stated  that  a  very  low  rate  of  early  output  resulted 
in  additional  costs  and  that  subsequent  higher  production 
rates  resulted  in  cost  benefits.  In  this  study  the  data 
used  in  studying  labor  hours  was  identical  to  that  used  by 
Smith,  so  it  is  not  surprising  that  Dreyfuss  and  Large 
reached  conclusions  similar  to  Smith's  (4:18-21). 

Alchian  and  Allen.  Alchian  and  Allen  suggested  that  as 
production  rates  increase,  unit  costs  should  increase  also. 
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They  felt  that  the  use  of  less  efficient  workers  and  the  use 
of  overtime  will  cause  this  increase  in  costs.  Their  con¬ 
clusions  were  not  based  on  empirical  studies  but  rather 
on  a  subjective  analysis  of  the  work  environment  (1:19-20). 
Subsequent  studies,  which  applied  rigorous  scientific 
analysis  to  specific  production  data,  disproved  Alchian 
and  Allen's  subjective  conclusions. 

SUMMARY 

The  learning  curve  has  found  widespread  use  in 
DOD  acquisition  efforts.  The  development  of  a  model  which 
incorporates  changes  in  production  rate  proved  to  be  an 
effective  predictor  for  airframes  and  might  also  be 
applicable  in  related  areas,  such  as  aircraft  engine 
production.  The  next  step  will  be  to  describe  the  specific 
methodology  necessary  to  test  the  research  hypotheses. 
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CHAPTER  III 


RESEARCH  METHODOLOGY 

This  chapter  outlines  the  research  hypotheses  and 
the  procedures  used  to  test  them  and  is  divided  into  six 
sections  as  follows: 

1.  Objectives  and  approach; 

2.  Model  variables; 

3.  Model  definitions  and  assumptions; 

4.  Research  hypotheses; 

5.  Data  collection  and  treatment;  and 

6.  Summary. 

OBJECTIVES  AND  APPROACH 

The  objectives  of  this  research  were:  (1)  to  deter¬ 
mine  if  the  direct  labor  requirements  for  aircraft  engine 
production  were  affected  by  the  production  rate,  and  (2) 
to  determine  if  the  production  rate  model  was  a  better 
predictor  of  labor  requirements  than  the  basic  learning 
curve  model.  Meeting  these  objectives  established  the 
applicability  of  Smith's  production  rate  model  to  aircraft 
engine  production. 

The  approach  was  to  collect  historical  production 
data  on  three  aircraft  engines,  the  J-79  manufactured  by 


24 


General  Electric,  the  TF-41  manufactured  by  Allison,  and 
the  F-100  manufactured  by  Pratt  and  Whitney,  and  to  evalu¬ 
ate  these  data  using  Smith's  production  rate  model.  As 
with  Smith's  research  in  airframe  production,  the  produc¬ 
tion  rate  model  was  adjusted  to  the  specific  data  groups 
and  no  attempt  was  made  to  formulate  a  general  labor  hour 
model  to  be  used  in  all  aircraft  engine  production. 

MODEL  VARIABLES 

The  three  variables  used  in  this  analysis  were  as 
follows*.  (1)  direct  labor  hours1  per  aircraft  engine  pro- 
duced;  (2)  cumulative  number  of  engines  produced;  and  (3) 
the  aircraft  engine  production  rate.  Since  it  was  considered 
desirable  to  improve  the  ability  to  predict  the  direct  labor 
hours  required  per  engine,  this  was  treated  as  the  dependent 
variable.  Cumulative  engines  produced  and  production  rate 
were  considered  the  independent  variables. 


1For  one  set  of  data,  that  of  the  F-100  engine, 
historical  records  were  maintained  in  standard  labor  dollars 
instead  of  labor  hours.  Consequently,  the  labor  dollar 
figure  served  as  a  proxy  for  labor  hours  for  this  set  of 
data.  An  explanation  of  this  proxy  is  provided  in  the 
data  collection  and  treatment  section  of  this  chapter. 

2 

Due  to  the  complexity  and  nature  of  aircraft  engine 
production,  the  only  feasible  measure  of  production  accom¬ 
plishment  was  the  number  of  engines  completed.  Consequently, 
each  aircraft  engine  was  treated  as  an  equivalent  unit  of 
production  in  the  research. 
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The  Direct  Labor  Hours  Variable 


Direct  labor  for  aircraft  engines  can  be  divided 
into  three  categories*  fabrication,  assembly,  and  test. 

The  labor  required  for  testing  was  a  small  portion  of  the 
total  direct  labor  and  was  combined  with  the  labor  for 
assembly  by  some  manufacturers.  The  dependent  variable, 
labor  hours,  was  expressed  three  ways  for  the  J-79  engine*, 
as  total  direct  labor,  as  assembly  and  test  labor,  and  as 
fabrication  labor.  The  total  labor  hours  included  only 
that  fabrication  portion  which  was  accomplished  by  the 
engine  manufacturer,  and  did  not  include  labor  for  parts 
which  were  produced  by  subcontractors.  For  the  TF-41  and 
F-100  engines,  the  dependent  variable  was  expressed  only 
as  total  direct  labor,  because  only  total  direct  labor 
figures  were  available. 

The  Cumulative  Output  Variable 

Records  for  aircraft  engine  production  were  kept 
of  the  number  of  engines  completed  each  month.  The  cumula¬ 
tive  output  variable  was  the  total  number  of  engines  com¬ 
pleted  since  the  beginning  of  the  production  program,  as 
calculated  on  the  last  day  of  each  accounting  month. 

The  Production  Rate  Variable 


The  rate  of  production  of  an  aircraft  engine  was 


impossible  to  accurately  determine,  so  a  proxy  was  developed 
for  the  model.  Since  engine  production  data  was  recorded 
by  the  number  of  engines  finished  each  month,  a  daily 
average  production  rate  for  each  month  was  developed  by 
dividing  the  number  of  engines  finished  during  each  month 
by  the  number  of  working  days  in  that  month.  This  was  simi¬ 
lar  to  the  lot  average  delivery  rate  used  by  Smith  in  his 
work  on  airframes  (11:41).  Smith  also  used  a  lot  average 
manufacturing  rate  which  was  calculated  by  dividing  the 
number  of  airframes  in  a  lot  by  the  production  time  span. 
However,  the  production  time  span  was  not  available  for  the 
selected  aircraft  engines.  Smith  reported  only  a  small 
difference  in  the  results  obtained  using  the  two  models 
(11:144),  so  no  significant  loss  of  accuracy  should  have 
occurred  through  use  of  the  monthly  completion  rate  in 
developing  the  proxy. 

MODEL  DEFINITION  AND  ASSUMPTIONS 

Chapter  II  discussed  the  two  models  used  by  Smith 
which  he  called  the  "full  model"  and  the  "reduced  model". 
These  two  models,  used  in  this  research,  are  repeated  here*. 

M o del  Definition 


The  reduced  model  is  the  basic  learning  curve 


stated  as  t 


Y^  represents  the  unit  average  direct  labor 
hours  required  for  each  engine? 

Xii  represents  the  cumulative  output  of  all 
engines  through  the  i  th? 

X2i  represents  the  production  rate  of  the 
engines  in  group  i? 

e^  represents  the  variation  which  is  left 

unexplained  by  the  variables  in  the  model? 
and 


B0.  ,  and  B 2  are  regression  coefficients. 

In  order  to  use  multiple  linear  regression  to  analyze 
the  two  models ,  they  were  transformed  to  a  linear  form  by 
taking  the  logarithm  of  each  term.  The  logarithmic  form  of 
the  reduced  model  is  ? 


Log  Yi  =  Log  Bq  +  B1  Log  +  ei 
and  the  logarithmic  form  of  the  full  model  is  j 

Log  Y^  =  Log  Bq  +  B-l  Log  X.^  +  B2  Log  Xgi  +  e.^  . 
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Assumptions 

The  statistical  significance  of  the  results  of  the 
regression  was  tested  using  appropriate  F-distribution 
statistics.  To  establish  the  validity  of  these  tests,  it 
was  necessary  to  make  some  assumptions  concerning  the  error 
terms  in  the  model.  To  begin  with,  the  error  terms  were 
assumed  to  be  normally  distributed  with  a  mean  of  zero  and 
equal  variance.  Also,  the  error  terms  were  assumed  to  be 
independent  of  each  other  and  of  the  independent  variables. 

A  third  assumption  concerns  a  problem  which  fre¬ 
quently  develops  in  a  multiple  regression,  that  of  multi- 
collinearity .  Multicollinearity  exists  when  there  is  a 
relationship  between  or  among  independent  variables,  which 
in  this  research  were  the  cumulative  output  and  the  produc¬ 
tion  rate  variables.  If  a  high  degree  of  collinearity  exists 
between  or  among  independent  variables  in  multiple  regres¬ 
sion,  the  F-test  may  find  the  marginal  contribution  of  one 
or  more  variables  to  be  statistically  insignificant,  while 
they  may  in  fact  be  good  explainers  of  variation  in  the 
dependent  variable  if  considered  separately  (8t34l). 

While  multicollinearity  can  be  a  serious  problem 
if  the  model  is  to  be  used  for  control,  it  is  not  as  serious 
a  problem  when  the  purpose  of  the  model  is  to  predict  as  was 
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the  case  in  this  research.  The  contribution  made  by  adding 
the  production  rate  to  the  reduced  model  was  subjectively 
evaluated  by  comparing  predictions  of  the  reduced  model  to 
those  of  the  full  model.  Therefore,  it  was  assumed  the 
varying  degrees  of  multicollinearity  had  no  substantial 
impact  on  the  short-range  predictive  abilities  of  the 
models . 


RESEARCH  HYPOTHESES 

Four  hypotheses  were  tested.  The  first  was  that 
the  production  rate  explained  a  significant  portion  of  the 
variation  in  total  direct  labor  requirements  for  aircraft 
engine  production.  The  second  and  third  hypotheses  were 
that  the  production  rate  explained  a  significant  portion 
of  the  variation  in  direct  fabrication  labor  requirements 
and  direct  assembly  and  test  labor  requirements,  respec¬ 
tively.  (Because  the  data  for  the  F-100  and  TF-41  engines 
were  not  divided  into  these  categories,  these  two  hypotheses 
were  tested  on  the  J-79  engine  data  only.)  The  fourth  hypo¬ 
thesis  was  that  the  model  which  included  the  production 
rate  variable  was  a  better  predictor  of  total  direct  labor 
requirements  than  was  the  reduced  model. 

Research  Hypothesis  One 

Testing  of  the  first  research  hypothesis  involved 


two  statistical  tests  and  two  criterion  tests.  First,  re¬ 
gression  analysis  was  performed  on  the  historical  aircraft 
engine  production  data.  Next,  the  statistical  significance 
of  the  regression  model  parameters  was  tested.  Finally,  two 
criterion  tests  were  used  to  evaluate  the  appropriateness  of 
the  model  for  the  data.  The  full  model  in  log-linear  form 
was  used  in  the  tests.  The  dependent  variable  in  the  regres¬ 
sion  analysis  was  the  logarithm  of  average  total  direct  labor 
hours  (or  labor  hour  proxy)  per  equivalent  unit,  measured  by 
month.  The  independent  variables  were  the  logarithm  of  the 
cumulative  production  quantity  as  of  the  end  of  each  month 
and  the  logarithm  of  each  month's  production  rate. 

Statistical  Hypothesis  One  (A).  This  hypothesis  was  that  the 
cumulative  production  quantity  and/or  the  production  rate  were 
related  to  direct  labor  hours  per  unit  as  indicated  in  the 
model.  The  null  and  alternate  hypotheses  were  formally  es¬ 
tablished  as  follows*. 

HqJB^  and  B2  =  0 

H1:B1  ^  0  and/or  /  0 

The  decision  criterion  was  as  follows*  The  null 
hypothesis  was  rejected  and  the  alternate  hypothesis  accepted 
if  the  test  statistic  F  was  greater  than  the  critical  statistic 
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Fc  at  the  .05  level  of  significance-^.  In  this  statistical 
test,  F  =  MSR  -  MSE,  MSR  =  SSR  -  (p-l)  and  MSE  =  SSE  -  (n-p) 
where : 

MSR  represents  the  mean  of  the  regression  sum  of 
squares  in  logarithmic  forms 

MSE  represents  the  mean  of  the  residual  (or  error) 
sum  of  squares  in  logarithmic  forms 

SSR  represents  the  regression  sum  of  squares  in 
logarithmic  form; 

SSE  represents  the  residual  sum  of  squares  in 
logarithmic  form; 

p  represents  the  number  of  regression  parameters; 
and 

n  represents  the  number  of  observations  (8:45, 

79,  227-8). 

This  test  of  the  F  statistic  was  simply  a  comparison  of  the 
explained  variance  to  the  unexplained  variance  to  determine 
the  ability  of  the  model  to  explain  the  variance  of  the 
dependent  variable. 

Statistical  Hypothesis  One  (B).  This  hypothesis  focused  on 
the  production  rate  variable  to  determine  if  this  variable, 


^F  values  were  obtained  from  an  F-distribution  table 
(8:807-13)-  ° 
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when  combined  with  the  cumulative  production  quantity  vari¬ 
able,  explained  additional  variation  in  direct  labor  hours 
per  aircraft  engine.  Stated  statistically,  the  null  and 
alternate  hypotheses  weres 

VB2  =  0 

^  s  B2  /  0 

As  with  the  test  for  hypothesis  one  (A),  the  null 
hypothesis  was  rejected  and  the  alternate  hypothesis  accepted 
if  the  test  statistic  F*  was  greater  than  the  critical  sta¬ 
tistic  Fc  at  the  .05  level  of  significance. 

For  this  statistical  test  the  value  of  F*  was  deter¬ 
mined  as  follows  s 

F*  =  A  R2/g _ 

(1-R2 ) (n-k-1) 

where  t 

2 

A.  R  represents  the  increase  in  explained  varia¬ 
tion  caused  by  the  addition  of  the  logarithm 
of  the  production  rate  variable  to  the  reduced 
model} 

g  represents  the  number  of  variables  ( in  this 

2 

case,  one)  which  cause  the  increase  in  R  ; 

n  represents  the  number  of  observations; 

k  represents  the  total  number  of  regressors;  and 
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n-k-1  represents  the  degrees  of  freedom  in  the 
unexpla ined  variation  (14:435). 

In  other  words,  the  F*  statistic  for  this  test  was  the  ratio 
of  the  increase  in  explained  variance  to  the  remaining  unex¬ 
plained  variance,  obtained  by  transitioning  from  the  reduced 
model  to  the  full  model. 

Criterion  Test  One  (A).  The  aptness  of  the  regression  model 
as  a  best  estimator  of  aircraft  engine  direct  labor  hours 
%as  based  on  certain  assumptions  concerning  the  residuals 
or  observed  errors.  The  model  could  not  be  deemed  appro¬ 
priate  for  the  data  unless  assumptions  about  constant  vari¬ 
ance  of  residuals,  residual  independence,  and  normal  distri¬ 
bution  of  the  residuals  could  not  be  rejected  on  the  basis 
of  appropriate  tests  which  will  now  be  described  (8:239-50). 

The  assumption  of  constant  residual  variance  (homo- 
scedasticity)  was  tested  by  plotting  the  residual  values 
against  the  predicted  values  of  the  dependent  variable.  The 
assumption  held  if  there  was  no  discernible  pattern  to  the 
plot  and  if  most  residuals  were  within  one  standard  error 
of  the  estimate  (8:239-40).  Another,  more  objective  test 
of  the  assumption  can  be  made  by  use  of  a  rank  correlation 
coefficient  (8:112). 

The  assumption  that  residuals  are  independent  of 
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each  other  and  of  the  independent  variables  was  tested  by 
plotting  the  residual  values  against  the  values  of  each 
independent  variable.  The  assumption  held  if  no  pattern 
was  detected  and  if  the  residual  values  fluctuated  randomly 
around  the  base  line  of  zero.  In  this  test,  the  data  points 
were  arranged  in  time  order  sequence  so  that  any  existing 
pattern  could  have  been  detected.  Care  was  taken  to  insure 
that  trends  in  unit  data  which  were  the  result  of  engineering 
or  model  changes  were  not  mistakenly  identified  as  viola¬ 
tions  of  the  assumption  of  residual  independence  (11:51) • 

An  alternate  method  of  testing  independence  of  residuals 
is  the  Durbin-Watson  test  for  autocorrelation  in  which  a 
test  value  is  computed  from  the  sample  and  compared  to  a 
chart  interval  of  values.  If  the  test  value  falls  within 
the  interval,  the  condition  of  autocorrelation  can  be 
rejected  (14:720s  8:112;  358-61). 

The  assumption  of  normal  distribution  of  residuals, 
which  is  essential  to  the  accuracy  of  the  F  statistic  tests 
described  earlier,  may  be  tested  in  two  ways.  First,  the 
residuals  may  be  plotted  on  normal  probability  paper.  For 
the  assumption  to  hold,  the  plot  should  approximate  a  straight 
line.  Second,  the  chi-square  or  Kolmogorov-Smimov  test  may 
be  applied  to  test  the  assumption  (8:112,  506).  The  first 
method,  which  is  the  faster  of  the  two,  was  used  in  this 
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Criterion  Test  One  (B).  The  appropriateness  of  the  model  as 
an  estimator  of  direct  labor  was  further  tested  by  measuring 
the  proportion  of  variation  in  direct  labor  which  was  explained 

by  the  regression  model.  The  multiple  coefficient  of  deter- 

2  2 
mination,  known  as  R  ,  was  used  to  conduct  this  test.  R  was 

calculated  by  subtracting  the  quotient  of  SSE/SSTO  from  one. 

The  error  sum  of  squares,  SSE,  was  the  summation  of  all  squared 

residuals,  and  was  formally  defined  in  statistical  hypothesis 

one  (A).  The  total  sum  of  squares,  SSTO ,  was  calculated  by 

summing  the  squared  differences  between  each  observed  value 

of  the  dependent  variable  and  the  mean  of  the  dependent 

variable  ( 8  *  77 ) - 

In  the  regression  model  used  in  this  research,  the 
2 

interpretation  of  R  as  a  valid  measure  of  explained  variation 
was  somewhat  obscured  by  the  transformation  of  the  model  to 

logarithmic  form.  The  logarithmic  values  of  the  deviation 

.  .  2 
m  the  dependent  variable,  when  squared  to  compute  the  R 

statistic,  yielded  a  ratio  which  was  valid  only  to  this 

logarithmic  form  of  the  model.  A  more  meaningful  statistic, 

p 

R  (actual),  was  developed  by  Smith  for  use  in  his  research 
( 11 s 53 ) .  To  develop  this  statistic,  the  SSTO  and  SSE  values 
were  calculated  after  transforming  observed  and  predicted 
values  of  the  dependent  variable  from  logarithmic  to  actual 
form.  R  (actual)  was  then  calculated  by  subtracting  SSE 
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( actual )/SSTO  (actual)  from  one,  and  represented  the  vari¬ 
ation  in  actual  hours  which  was  explained  by  the  regression 
model. 

An  appropriate  model  for  the  data  would  explain  a 

high  proportion  of  variation  in  direct  labor,  and  would  con- 

2 

sequently  yield  a  high  R  (actual).  Therefore,  in  this  cri- 

2 

terion  test,  an  R  (actual)  value  of  .80  or  higher  was  se¬ 
lected  as  the  level  at  which  the  model  could  not  be  rejected 
as  inappropriate . 

If  the  model  was  not  rejected  by  either  of  the 
statistical  tests  or  criterion  tests,  its  predictive  ability 
was  then  tested  under  research  hypothesis  four. 

Research  Hypothesis  Two 

This  hypothesis  was  identical  to  the  first  research 
hypothesis  except  that  direct  fabrication  labor  requirements 
were  substituted  for  total  direct  labor  requirements.  Since 
the  only  change  involved  the  model's  dependent  variable,  the 
same  statistical  hypotheses  and  criterion  tests  were  used  to 
evaluate  the  model,  and  the  procedures  for  evaluating  the 
hypothesis  were  identical  to  those  for  the  first  research 
hypothesis . 

Research  Hypothesis  Three 


This  hypothesis  was  identical  to  the  first  research 


hypothesis  except  that  direct  assembly  and  test  labor  require¬ 
ments  were  substituted  for  total  direct  labor  requirements. 

As  with  the  second  research  hypothesis,  tne  same  statistical 
hypotheses  and  criterion  tests  were  used  to  evaluate  the 
model,  and  the  procedures  for  evaluating  the  hypothesis 
were  identical  to  those  for  the  first  research  hypothesis. 

Research  Hypothesis  Four 

A  primary  objective  of  the  proposed  research  was 
to  determine  the  form  of  the  learning  curve  which  was  best 
able  to  predict  direct  labor  hours  in  a  continuing  aircraft 
engine  production  program.  The  importance  of  an  accurate 
cost  forecasting  model  for  use  in  DOD  aircraft  engine 
acquisition  programs  has  been  stressed  earlier.  Once  the 
full  model  was  successfully  developed  under  one  of  the  pre¬ 
ceding  research  hypotheses,  its  predictive  ability  was  com¬ 
pared  to  that  of  the  reduced  model,  to  determine  which  model 
was  more  accurate,  and  further,  to  determine  the  practical 
value  of  the  model's  predictive  ability. 

The  fourth  research  hypothesis  was  that  for  12 
months  into  the  future  the  full  model  would  be  a  better  pre¬ 
dictor  than  the  reduced  model.  A  test  of  this  hypothesis 
with  actual  predicted  data  would  have  necessitated  applica¬ 
tion  of  the  models  over  a  period  of  time  in  a  continuing 
production  program.  To  simulate  this  situation,  the  full 
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and  reduced  regression  models  were  developed  with  the  last 
12  observed  data  points  (months)  omitted.  Then,  using  these 
models,  omitted  values  (which  were  known  but  not  used  in  es¬ 
timating  the  model  coefficients)  were  predicted.  The  fourth 
research  hypothesis  was  accepted  or  rejected  based  on  an 
evaluation  of  the  deviation  of  the  predicted  values  from 
the  observed  values,  for  both  the  full  and  the  reduced 
models . 

The  fourth  research  hypothesis  was  evaluated  using 
both  a  statistical  hypothesis  and  a  criterion  test.  The 
statistical  hypothesis  was  used  to  determine  whether  the 
full  model  was  significantly  better  than  the  reduced  model 
in  predicting  the  labor  hour  values  omitted  in  the  predic¬ 
tion  simulation.  Where  the  full  model  was  found  to  be  a 
significantly  better  predictor  based  on  the  statistical 
test,  a  criterion  test  was  then  applied  to  establish  whether 
the  improved  predictive  ability  of  the  full  model  had  a  prac¬ 
tical  significance  as  well. 

Statistical  Hypothesis  Four.  A  statistical  test  was  performed 
to  determine  if  the  average  absolute  deviation  of  the  full 
model  (  I  Dp  |  )  was  significantly  less  than  that  of  the  re¬ 
duced  model  (  |  Dp  |  ) .  The  average  absolute  deviation  for 
each  model  was  computed  by  taking  the  absolute  value  of  the 
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difference  between  the  actual  and  predicted  direct  labor 
hours  occuring  in  each  test  situation,  then  separately 
summing  the  absolute  deviations  for  each  model  in  all  test 
situations.  Stated  statistically,  the  null  and  alternate 
hypotheses  were: 

Hq  *  |Dr|  <  | Dpi 
%  :  |Dr|  >  I  Dpi 

The  hypothesis  was  tested  using  the  Student's 
t  distribution,  in  view  of  the  fact  that  the  number  of 
test  situations  were  few  (less  than  60).  The  assumptions 
of  normal  distribution  and  randomness  of  the  deviations, 
examined  in  research  hypothesis  one,  remained  in  effect 
during  this  test. 

The  decision  rule  using  the  Student's  t  statistic 
was  as  follows : 


Reject  Hq  if  t  >t  (  .05) 

where 

t  =  (IDr|  -|  DfI  )/\j  \ s2/n)  +  (s|/N) 

and 

2 

SR  represents  the  variance  of  the  distribution 
of  deviations  obtained  with  the  reduced  model; 

2 

Sp  represents  the  variance  of  the  distribution  of 
deviations  obtained  with  the  full  model; 
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N  represents  the  number  of  test  situations?  and 


tc  represents  the  critical  t  value  obtained  from 

a  table  of  Student's  t  critical  values  (14s208-15). 

Criterion  Test  Four.  Where  the  improved  predictive  ability 
of  the  full  model  over  the  reduced  model  was  proven  to  be 
statistically  significant,  the  model  was  then  subjected  to 
a  test  of  practical  significance.  This  test  was  deemed 
necessary  because  (1)  the  reduced  model,  although  proven 
to  be  a  statistically  less  accurate  predictor,  could  still 
be  sufficiently  accurate  for  practical  application,  or  (2) 
the  full  model,  although  proven  to  be  a  statistically  better 
predictor  than  the  reduced  model,  could  still  be  so  inaccur¬ 
ate  as  to  be  of  no  value  in  practical  application.  In 
either  of  the  above  two  instances,  the  addition  of  the 
production  rate  variable  would  not  be  considered  worthwhile 
from  a  cost/benefit  standpoint. 

For  the  criterion  test,  the,  predicted  versus  actual 
values  of  the  last  12  data  points  were  compared  for  the  full 
and  reduced  models.  For  each  model,  the  percent  deviation 
of  the  predicted  value  from  the  actual  value  for  each  data 
point  was  multiplied  by  the  equivalent  units  produced  during 
that  month,  and  the  results  were  summed.  This  figure  was 
then  divided  by  the  total  number  of  units  produced  over  the 
12 -month  period,  which  yielded  the  percent  deviation  of  the 
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12-month  prediction  from  the  actual  direct  labor  costs  for 
the  period.  This  criterion  test  was  considered  appropriate, 
because  it  was  the  model’s  ability  to  accurately  measure  a 
year's  (or  other  contract  negotiation  time  span’s)  direct 
labor  costs,  not  the  weekly  and  monthly  fluctuations  in 
these  costs,  which  was  the  primary  focus  of  this  research. 

The  full  model  was  judged  to  have  the  better  practical  pre¬ 
dictive  ability  only  when  (1)  it  had  a  smaller  percent  devia¬ 
tion  from  actual  direct  labor  costs  for  the  12 -month  period, 
and  (2)  it  was  subjectively  judged  to  have  a  sufficiently 

low  percent  deviation  so  as  to  prove  its  practical  value 
4 

as  a  predictor  . 


DATA  COLLECTION  AND  TREATMENT 

As  in  Smith’s  research  (11:57),  the  accessibility 
of  data  was  the  basis  for  selection  of  programs  to  be  studied 
in  this  research.  Historical  data  from  three  aircraft 


4 

This  subjective  criterion  for  hypothesis  acceptance 
or  rejection  was  arbitrarily  selected  on  the  basis  of  an 
analysis  of  the  DOD  acquisition  process.  Any  improvement 
in  predictive  ability,  no  matter  how  small,  could  result 
in  substantial  savings  for  high  dollar  value  programs. 

However,  if  the  increase  in  predictive  ability  were  small, 
the  value  of  the  model  would  be  questionable  for  low  dollar 
value  programs.  This  limitation  should  be  considered  prior 
to  application  of  the  model. 
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engine  production  programs,  the  J-79,  the  TF-41,  and  the 
F-100,  were  obtained.  The  J-79  data  set,  consisting  of 
52  data  points,  was  obtained  directly  from  the  manufac¬ 
turer's  computerized  records.  The  TF-41  data  set,  con¬ 
sisting  of  126  data  points,  was  obtained  from  the  Defense 
Contract  Administration  System  Program  Office  (DCASPRO) 
located  at  the  manufacturer’s  plant.  The  F-100  data  set, 
consisting  of  64  data  points,  was  obtained  from  the  F-100 
engine  branch  of  the  Propulsion  System  Program  Office 
(Propulsion  SPO)  at  Wright  Patterson  AFB.  For  all  three 
sets  of  data,  each  data  point  consisted  of  one  calendar 
month's  production  effort.  Each  month's  figures  provided 
the  number  of  engines  (or  equivalent  units)  completed  during 
that  month,  the  average  direct  labor  per  engine  for  those 
engines  completed,  and  the  cumulative  number  of  engines 
produced,  as  of  the  end  of  the  month,  from  the  beginning 
of  the  production  program.  Model  variables  were  derived 
from  this  data  as  discussed  below. 

Treatment  For  Direct  Labor  Hours 

Due  to  differences  in  format  among  the  three 
data  sets,  treatment  will  be  discussed  separately  for 
each  aircraft  engine  1 

J-79  Direct  Labor  Data.  Direct  labor  hours  for  the  J-79 
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production  program  were  computed  as  actual  average  direct 
labor  hours  per  engine  for  all  J-79  engines  completed  during 
a  particular  month  (data  point).  These  direct  labor  hours 
were  provided  in  two  distinct  direct  labor  categories* 
fabrication  and  the  sum  of  assembly  and  test.  Three 
separate  models  were  therefore  developed  for  the  J-79  engine. 
Fabrication  direct  labor  hours  and  assembly  and  test  direct 
labor  hours  were  summed  to  produce  total  direct  labor 
hours  (Y^),  the  dependent  variable  in  the  first  model 
(Model  1).  Fabrication  direct  labor  hours  (Yf)  was  the 
dependent  variable  in  the  second  model  (Model  2).  Finally, 
assembly  and  test  direct  labor  hours  (Y_ )  was  the  dependent 

a 

variable  in  the  third  model  (Model  3)* 

TF-41  Direct  Labor  Data.  TF-41  direct  labor  hour  data  was 
available  in  the  same  format  as  the  J-79  data  except  breakout 
between  fabrication  and  test  and  assembly  was  not  available. 
Due  to  two  accounting  method  changes  and  one  production 
method  change  during  the  production  program,  data  values 
were  transformed  to  provide  data  continuity  for  the  model. 

Two  models  were  developed  and  are  discussed  next. 

The  first  model  (Model  4)  incorporated  the  two 
accounting  changes.  At  the  15th  data  point,  the  manufac¬ 
turer's  accounting  system  redesignated  indirect  support  as 


a  portion  of  direct  labor.  The  increase  in  direct  labor 
for  all  of  the  remaining  data  points,  as  a  result  of  this 
change,  averaged  18  percent  as  calculated  by  the  manufacturer. 
In  order  to  provide  data  continuity,  direct  labor  figures 
for  the  first  14  data  points  were  each  increased  by  this 
18  percent  factor.  At  the  51st  data  point,  the  manufac¬ 
turer’s  accounting  system  redesignated  material  handlers' 
labor  as  a  portion  of  direct  labor.  The  manufacturer  cal¬ 
culated  the  resulting  increase  in  direct  labor  for  the  re¬ 
maining  data  points  to  be  an  average  of  3.3  percent.  Con¬ 
sequently,  the  first  50  data  points  were  each  increased  by 
this  3*3  percent  factor.  The  dependent  variable  in  Model  4 
was  the  resultant  monthly  direct  labor  hour  figure  for  each 
data  point. 

The  second  model  (Model  5)  reflected  the  production 
method  change  in  addition  to  the  two  accounting  changes. 

The  rate  of  production  of  the  TF-41  engine  Was  drastically 
reduced  beginning  with  the  101st  data  point.  As  a  consequence, 
the  manufacturer  initiated  a  new  production  method  whereby 
fabrication  of  engine  parts  was  accomplished  twice  a  year 
at  short  intervals.  These  breaks  in  the  fabrication  aspects 
of  the  production  program  introduced  "negative  learning"  to 
the  fabrication  process.  The  manufacturer  calculated  that 
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the  monthly  direct  labor  hour  figures  were  increased  by 
21.81  percent  as  a  result  of  this  production  method 
change.  Accordingly,  all  direct  labor  figures  following 
this  change  were  adjusted  by  a  factor  of  1/1.2181  to  pro¬ 
vide  continuity  for  data  before  and  after  the  production 
slowdown.  The  resultant  direct  labor  hour  data  was  used 
in  Model  5*  Model  4  and  Model  5  were  both  analyzed  in  this 
research  because  of  lack  of  substantiation  for  the  manufac¬ 
turer's  21.81  percent  production  method  change  figure. 

F-100  Direct  Labor  Data.  The  direct  labor  data  obtained 
from  the  manufacturer  through  the  Propulsion  SPO  for  the 
F-100  engine  were  provided  as  actual  average  direct  labor 
costs  (dollars)  per  engine  for  all  engines  completed  during 
a  particular  month  (data  point);  no  direct  labor  hour  figures 
were  available.  All  dollar  figures  were  standardized  to 
January  1976  dollars  using  a  standardization  factor  pecu¬ 
liar  to  the  manufacturer's  plant;  consequently,  the  loss 
of  accuracy  in  using  direct  labor  dollars  in  place  of  direct 
labor  hours  for  this  data  set  was  considered  minimal.  The 
standardized  dollar  figures,  a  proxy  for  direct  labor  hours, 
were  used  as  the  dependent  variable  in  Model  6. 

Treatment  for  Cumulative  Output 

The  manufacturers  of  all  three  engines  analyzed  in 


this  research  maintained  accurate  records  of  the  number 
of  engines  (or  equivalent  units)  which  were  finished  during 
each  calendar  month  of  the  production  program.  Since  each 
calendar  month  for  which  the  necessary  data  was  available 
was  treated  as  a  data  point,  the  cumulative  output  variable 
was  computed  simply  by  adding  each  month's  completion  figure 
to  the  sum  of  all  units  completed  in  the  program  prior  to 
that  month. 

Treatment  For  Production  Rate 

The  production  rate  proxy  used  in  this  research  was 
a  daily  average  production  rate  for  each  month,  obtained  by 
dividing  the  number  of  engines  (or  equivalent  units)  finished 
during  each  month  by  the  number  of  working  days  in  that  month. 
The  rationale  for  using  this  proxy  has  been  described  in 
the  model  variables  section  of  this  chapter.  The  number 
of  engines  finished  during  each  month  was  obtained  directly 
from  the  manufacturers'  data,  as  discussed  in  the  preceding 
paragraph.  Each  manufacturer's  plant  operating  schedule  and 
holiday  schedule  were  used  to  calculate  the  actual  number 
of  working  days  which  occurred  during  each  month  used  as 
a  data  point.  Care  was  taken  to  insure  that  hours  per  work¬ 
ing  day  remained  constant  for  all  data  points  in  each  data 
set?  in  those  few  instances  where  a  working  day  of  shorter 
duration  occurred,  that  working  day  was  reduced  to  a 

4? 
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proportionate  fraction  of  the  standard  working  day  used  on 
the  production  program. 

Data  Treatment  Summary 

The  monthly  engine  production  data,  obtained  from 
the  manufacturer  for  the  J-79  program,  from  the  DCASPRO  for 
the  TF-41  program,  end  from  the  Propulsion  SPO  for  the  F-100 
program,  were  used  to  develop  the  one  dependent  and  two  inde- 
pent  variables  used  in  the  regression  analysis.  The  nature 
of  the  data  resulted  in  the  formation  of  six  separate  models 
for  regression.  These  models  are  summarized  as  follows i 

TABLE  4 


SUMMARY  OF  MODELS  FOR  REGRESSION 


Model 

Engine 

Dependent  Variable 
(direct  labor  per  engine 
or  equivalent  unit) 

1 

J-79 

total  hours 

2 

J-79 

fabrication  hours 

3 

J-79 

assembly  and  test  hours 

4 

TF-41 

total  hours  (adjusted  for 
two  accounting  changes) 

5 

TF-41 

total  hours  (adjusted  for 
two  accounting  and  one 
production  method  changes) 

6 

F-100 

total  cost  (standard 
dollars) 

Computations  for  the  independent  variables,  cumulative  units 
and  production  rate,  were  similar  for  all  six  models. 

SUMMARY 

Least  squares  multiple  linear  regression  was  used 
in  this  research  to  analyze  historical  aircraft  engine  pro¬ 
duction  data.  The  research  hypotheses  were  tested  using 
the  statistical  and  criterion  tests  described  in  this 
chapter. 

The  first  three  research  hypotheses  were  evaluated 
using  statistical  tests  structured  to  test  the  effect  of 
production  rate  changes  on  direct  labor  requirements  for 
aircraft  engine  production.  These  tests  first  evaluated 
the  appropriateness  of  the  full  model,  then  the  contribu¬ 
tion  of  the  production  rate  variable.  Next,  two  criterion 
tests  were  used,  one  to  test  the  assumptions  necessary  to 
the  model,  and  a  second  to  determine  the  proportion  of 
variation  explained  by  the  regression  model.  When  both 
the  statistical  and  the  criterion  tests  were  passed,  the 
conclusion  reached  was  that  the  production  rate  variable 
was  an  important  explainer  of  the  variation  in  direct  labor 
requirements  for  aircraft  engine  production. 

The  final  hypothesis,  that  the  full  model  was  a 
better  predictor  than  the  reduced  model,  was  evaluated  by 
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simulating  predictions  of  the  last  12  data  points  collected 
in  each  data  set.  The  evaluation  was  a  subjective  procedure 
concerned  with  comparing  the  predictive  abilities  of  the  two 
models.  The  full  model  was  judged  a  better  predictor  if  its 
predictions  deviated  from  observed  values  to  a  lesser  degree 
than  the  predictions  of  the  reduced  model,  and  if  it  was  sub¬ 
jectively  judged  to  be  of  practical  significance. 

In  order  to  draw  conclusions  with  any  degree  of  cer¬ 
tainty,  the  assumptions  necessary  to  the  regression  model 
must  hold.  Also,  the  methodology  contains  certain  limita¬ 
tions  which  must  be  considered  throughout  the  analysis.  Due 
to  their  importance,  a  summary  of  these  assumptions  and 
limitations  follows. 


Assumptions 

•  Historical  data  used  in  the  research  were  accur¬ 


ate  . 


•  No  significant  loss  of  data  precision  was  in¬ 
duced  by  the  logarithmic  transformation  of  the  data  used 
to  facilitate  multiple  linear  regression. 

•  Data  measurements  and  transformations  were  accur¬ 


ate  . 

•  The  appropriateness  of  the  model  was  not  im¬ 
paired  by  multicollinearity  between  the  independent 
variables. 
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Limitations 


•  Subjective  analysis  was  required  to  assess  the 
validity  of  the  assumptions  concerning  error  terms. 

•  The  utility  of  the  full  model  as  a  predictive 
device  must  be  subjectively  determined  based  on  the  dollar 
value  of  the  applicable  program  versus  the  increase  in  pre¬ 
dictive  ability  over  the  reduced  model. 

•  The  ranges  of  observations  in  the  data  bases 
constrain  the  utility  of  the  results  of  this  research. 
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CHAPTER  IV 


DATA  ANALYSIS  AND  EVALUATION 

This  chapter  provides  the  results  of  the  methodology 
described  in  Chapter  III,  as  applied  to  the  J-79,  TF-41,  and 
F-100  production  program  data  sets.  It  is  divided  into  four 
sections.  The  first  section  reports  on  the  analysis  of  the 
three  sets  of  J-79  data  with  Models  1  through  Two 

different  sets  of  TF-41  data  are  analyzed  with  Models  4  and 
5  in  the  second  section,  while  the  single  F-100  data  set  is 
examined  with  Model  6  in  the  third.  The  last  section  summa¬ 
rizes  the  analysis  by  comparing  and  contrasting  the  research 
results  of  the  separate  production  programs  in  light  of  the 
differences  in  data  and  the  unique  aspects  of  each  program. 

THE  J-79  PROGRAM 

The  data  obtained  on  the  J-79  production  program, 
unlike  those  of  the  other  two  aircraft  engines  examined  in 
this  research,  were  provided  in  separate  categories  of  fab¬ 
rication  data  and  test  and  assembly  data.  This  breakout  was 
desired  so  that  differing  effects  of  the  production  rate  on 
the  two  different  aspects  of  labor,  if  present,  could  be 


Table  4. 


5 


Regression  Models  1  through  6  were  summarized  in 
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detected.  Offsetting  this  attractive  attribute  of  the  J-79 
data,  however,  was  the  data's  position  near  the  end  of  a 
long  production  program.  The  manufacturer's  computerized 
records,  from  which  the  data  had  been  extracted,  had  only 
been  maintained  during  a  period  covering  unit  number  13172 
through  unit  number  14075 »  a  period  when  production  had 
been  slowed  as  the  program  approached  termination.  At  the 
onset  of  the  analysis,  then,  it  was  anticipated  that  the 
learning  curve  effect  of  the  cumulative  output  variable, 
intuitively  prominent  when  data  for  an  entire  production 
program  is  available,  woulu  be  minimal. 

Total  direct  labor  data,  fabrication  direct  labor 
data,  and  test  and  assembly  direct  labor  data  provided 
values  for  use  in  Models  1,  2,  and  3  respectively.  The 
vaxues  for  the  variables  in  the  models  were  calculated  as 
described  in  the  data  collection  and  treatment  section  of 
Chapter  III.  Both  the  full  and  reduced  forms  of  the  models 
were  then  regressed,  and  analysis  was  performed  on  the 
results^.  Specifically,  the  regression  results  were 


The  regression  analysis  in  this  research  was 
performed  through  use  of  a  modified  version  of  Smith's 
FORTRAN  IV  program  (11:147-153).  The  modified  program 
is  listed  in  Appendix  A.  A  similar  program  is  available 
for  use  by  government  price  analysts  in  the  COPPER  IMPACT 
Library  under  the  file  name  PRODRATE. 


53 


evaluated  for  the  three  models  using  the  two  statistical 
tests  and  two  criterion  tests  contained  in  each  model's 
initial  research  hypothesis.  None  of  the  three  models 
passed  all  four  tests,  so  the  fourth  research  hypothesis 
was  not  evaluated  for  any  of  the  J-79  data. 


Analysis  of  Research 
Hypothesis  One 


To  facilitate  understanding  and  provide  continuity, 
the  statistical  hypotheses  and  criterion  tests  for  research 
hypothesis  one  are  restated  in  summary  form.  A  discussion 
of  test  results  is  then  presented. 


Research  Hypothesis  One.  The  production  rate  explains  a 
significant  portion  of  the  variation  in  total  direct  labor 
requirements  for  aircraft  engine  production  when  included 
in  an  appropriate  model. 


Statistical  Hypothesis  One(A).  and  =  0;  ^ « B-j/  0 

and/or  B2  /  0 .  Reject  Hq  if  the  F  ratio  is  greater  than  Fc . 

Statistical  Hypothesis  One(B).  HQ:B2  =  0;  H^.Bg  /  0.  Reject 
Hq  if  the  F*  ratio  is  greater  than  F  . 

Criterion  Test  One(A).  The  model  cannot  be  deemed  appro¬ 
priate  unless  assumptions  about  constant  variance  of  resi¬ 
duals,  residual  independence,  and  normal  distribution  of 
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residuals  cannot  be  rejected  using  appropriate  tests. 


Criterion  Test  One(B).  The  model  cannot  be  deemed  appro- 
priate  unless  the  R  (actual)  is  greater  than  80  percent. 

Model  1  Test  Results.  Test  results  for  research  hypothesis 
one  are  presented  in  Table  5  for  Model  1.  For  clarity,  the 
model  and  its  variables  are  briefly  described  as  follows i 
Reduced  Model : 


or  in  logarithmic  form: 

log(Yt)  =  log(B0)  +  B1  '  log(X1). 
Full  Model: 


or  in  logarithmic  form: 

log(Yt)  =  log(B0)+B1  •log(X1)+B2’log(X2). 

where : 

Y^  represents  unit  cost  (total  direct  labor 
hours/equivalent  unit/ac counting  month), 

X.^  represents  cumulative  output  as  of  the  last 
day  of  each  accounting  month,  and 
X2  represents  daily  average  production  rate/ 
accounting  month. 

As  depicted  in  Table  5*  Model  1  was  not  validated 
for  further  testing  under  research  hypothesis  four.  Both 
the  full  and  the  reduced  forms  of  the  model  proved  to  be 
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TABLE  5 

RESEARCH  HYPOTHESIS  ONE 
RESULTS  FOR  GENERAL  ELECTRIC 


MODEL  1 


TESTED 

ITEMS 

REDUCED 

MODEL 

FULL 

MODEL 

Estimated  BQ 

Masked3, 

Masked 

Estimated  B1 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

4.12 

3.53 

F  Critical  (2,  52) 

— 

3*15 

Statistical  Hypothesis 

LA 

— 

Passed 

F* 

— 

2.78 

F  Critical  (1,  52) 

— 

4.00 

Statistical  Hypothesis 

IB 

— 

Failed 

Criterion  Test  1A 

— 

Failed 

R2 

.076 

.126 

R2  (Actual) 

.085 

.134 

Criterion  Test  IB 

— 

Failed 

Certain  table  values  have  been  masked  in  the 
published  version,  of  this  thesis,  because  these  data 
elements  are  considered  proprietary  by  the  manufacturer. 


significant  explainers  of  the  variation  in  the  dependent 
variable!  however,  the  production  rate  variable  did  not 
add  significantly  to  this  explanatory  ability.  Further¬ 
more,  the  assumption  concerning  independence  of  residuals 

2 

was  rejected  based  on  the  appropriate  test,  and  the  R 
(actual)  value  of  the  model  was  unacceptably  low.  The 
rejection  of  Model  1  as  an  appropriate  model  was  antici¬ 
pated  as  mentioned  previously  in  this  section  because  the 
data  used  for  the  analysis  was  from  a  period  late  in  the 
production  program,  where  the  learning  curve  effect  was 
negligible. 

Analysis  of  Research  Hypothesis  Two 

The  statistical  hypotheses  and  criterion  tests  for 
research  hypothesis  two  will  now  be  restated  in  summary 
form,  followed  by  a  discussion  of  test  results. 

Research  Hypothesis  Two.  The  production  rate  explains  a 
significant  portion  of  the  variation  in  fabrication  direct 
labor  requirements  for  aircraft  engine  production  when  in¬ 
cluded  in  an  appropriate  model. 

Statistical  Hypothesis  Two(A).  HgsB.^  and  B2=0;  iB^/O 
and/or  B2  /  0.  Reject  HQ  if  the  F  ratio  is  greater  than  Fc- 

Statistical  Hypothesis  Two(B).  ho,B2=0j  /  0.  Reject 
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Hq  if  the  F*  ratio  is  greater  than  F  . 

Criterion  Test  Two(A).  As  with  research  hypothesis  one, 
the  model  cannot  be  deemed  appropriate  unless  the  necessary 
assumptions  concerning  residuals  cannot  be  rejected. 

Criterion  Test  Two(B).  The  model  cannot  be  deemed  appro- 

2 

priate  unless  the  R  (actual)  is  greater  than  80  percent. 

Model  2  Test  Results.  Test  results  for  research  hypothesis 
two  are  presented  in  Table  6  for  Model  2.  The  model  and  its 
variables  are  briefly  described  as  follows: 


Reduced  Model: 


or  in  logarithmic  form: 

log(Yf)  =  log(B0)  +  B1  •  log(X1). 


Full  Model: 


or  in  logarithmic  form: 

log(Yf)  =  log(B0)+B1  •  log(X1)+B2'log(X2). 

where: 

Yf  represents  unit  cost  (fabrication  direct 

labor  hours/equivalent  unit/accounting  month), 
X^  represents  cumulative  output  as  of  the  last 
day  of  each  accounting  month,  and 
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TABLE  6 

RESEARCH  HYPOTHESIS  TWO 
RESULTS  FOR  GENERAL  ELECTRIC 
MODEL  2 


TESTED 

ITEMS 

REDUCED 

MODEL 

FULL 

MODEL 

Estimated  BQ 

Masked 

Masked 

Estimated 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

3-16 

3.24 

F  Critical  (2,  52) 

— 

3-15 

Statistical  Hypothesis  2A 

— 

Passed 

F* 

— 

3-18 

F  Critical  (1,  52) 

— 

4.00 

Statistical  Hypothesis  2B 

— 

Failed 

Criterion  Test  2A 

— 

Passed 

R2 

.060 

.117 

R2 (Actual) 

.067 

.125 

Criterion  Test  2B 

— 

Failed 

X2  represents  daily  average  production  rate/ 
accounting  month. 

Model  2  results,  as  shown  in  Table  6,  were  similar 
to  the  Model  1  results  for  the  two  statistical  tests?  that 
is,  the  model  was  a  significant  explainer  of  variation,  but 
the  production  rate  variable  did  not  add  significantly  to 
the  explanatory  ability.  The  assumptions  concerning  resi¬ 
duals  could  not  be  rejected  for  Model  2.  As  with  Model  1, 
the  R  (actual)  value  was  far  below  the  established  criterion 
of  .80.  As  a  consequence  of  these  results,  Model  2  could  not 
be  validated  for  further  testing  under  research  hypothesis 
four.  The  performance  of  Model  2  in  the  regression  analy¬ 
sis  reflected  the  close  relationship  of  the  Model  2  data  to 
the  Model  1  data,  in  that  fabrication  direct  labor  hours 
were  a  large  percentage  of  total  direct  labor  hours. 

Analysis  of  Research  Hypothesis  Three 

The  statistical  hypotheses  and  criterion  tests 
for  research  hypothesis  three  will  now  be  restated  in  sum¬ 
mary  form,  and  test  results  will  be  briefly  discussed. 

Research  Hypothesis  Three.  The  production  rate  explains  a 
significant  portion  of  the  variation  in  assembly  and  test 
direct  labor  requirements  for  aircraft  engine  production 
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when  included  in  an  appropriate  model. 


Statistical  Hypothesis  Three(A).  hq,B1  and  B2  =  Oj  0 

and/or  B2  /  0 .  Reject  HQ  if  the  F  ratio  is  greater  than  Fc- 

Statistical  Hypothesis  Three(B).  hq,B2  =  0j  H1,B2  ^  Re3ect 
HQ  if  the  F*  ratio  is  greater  than  Fq. 

Criterion  Test  Three(A).  As  with  research  hypothesis  one, 
the  model  cannot  be  deemed  appropriate  unless  the  necessary 
assumptions  concerning  residuals  cannot  be  rejected. 

Criterion  Test  Three (B).  The  model  cannot  be  deemed  appro- 
priate  unless  the  R  (actual)  is  greater  than  80  percent. 

Model  3  Test  Results .  Test  results  for  research  hypothesis 
three  are  presented  in  Table  7  for  Model  3.  The  model  and 
its  variables  are  briefly  described  as  follows i 


Reduced  Model: 


or  in  logarithmic  form: 

log(Ya)  =  log(B0)  +  B1  ’  log(X1). 


Full  Model: 


or  in  logarithmic  form: 

log(Ya)  =  log(B0)+B1'log(X1)+B2'log(X2). 


TABLE  7 


RESEARCH  HYPOTHESIS  THREE 
RESULTS  FOR  GENERAL  ELECTRIC 
MODEL  3 


TESTED 

ITEMS 

REDUCED 

MODEL 

FULL 

MODEL 

Estimated  BQ 

Masked 

Masked 

Estimated  B^ 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

2.21 

1.42 

F  Critical  (2,  52) 

— 

3.15 

Statistical  Hypothesis 

3A 

— 

Failed 

F* 

— 

0.64 

F  Critical  (1,  52) 

— 

4.00 

Statistical  Hypothesis 

3B 

— 

Failed 

Criterion  Test  3A 

— 

Passed 

R2 

.042 

•  055 

R2 (Actual) 

.063 

.063 

Criterion  Test  3B 

— 

Failed 

where  t 


Y_  represents  unit  cost  (assembly  and  test  direct 

a 

labor  hours/equivalent  unit/accounting  month), 

X^  represents  cumulative  output  as  of  the  last 
day  of  each  accounting  month,  and 
X2  represents  daily  average  production/accounting 
month . 

As  depicted  in  Table  7,  Model  3  was  not  validated 
for  further  testing  under  research  hypothesis  four.  Neither 
the  full  nor  the  reduced  form  of  the  model  proved  to  be  a 
significant  explainer  of  the  variation  in  the  dependent 
variable.  Two  direct  consequences  of  this  result  were 
that  (1)  the  addition  of  the  production  rate  variable  could 
not,  and  in  fact  did  not,  add  significantly  to  the  explana- 

p 

tory  ability  of  the  model}  and,  (2)  the  R  (actual)  value 
was  unacceptably  low.  The  model  passed  the  tests  concern¬ 
ing  the  assumptions  about  residuals. 

THE  TF-41  PROGRAM 

The  TF-41  program  data  used  in  this  research  cov¬ 
ered  the  entire  11-year  production  history  of  the  engine 
to  date,  beginning  with  unit  number  one  in  1968 .  With  the 
entire  production  history  reflected  in  the  data,  the  full 
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learning  curve  effect  of  the  cumulative  output  variable  was 
shown.  A  breakout  between  fabrication  direct  labor  and 
assembly  and  test  direct  labor  was  not  available,  so  analy¬ 
sis  of  the  explanatory  ability  of  the  appropriate  models 
was  confined  to  research  hypothesis  one.  Two  different 
models  were  used  in  this  analysis,  each  reflecting  different 
transformations  of  the  data  as  discussed  in  Chapter  III. 

Analysis  of  Research  Hypothesis  One 

To  provide  full  understanding  and  continuity,  the 
statistical  hypotheses  and  criterion  tests  for  research 
hypothesis  one  are  again  summarized  prior  to  a  discussion 
of  test  results  for  Model  4  and  Model  5* 

Research  Hypothesis  One.  The  production  rate  explains  a 
significant  portion  of  the  variation  in  total  direct  labor 
requirements  for  aircraft  engine  production  when  included 
in  an  appropriate  model. 

Statistical  Hypothesis  One(A) .  1 B1  and  B2  =  0 *  H1 1 Bl^  0 

and/or  B2  /  0 .  Reject  HQ  if  the  F  ratio  is  greater  than  Fc . 

Statistical  Hypothesis  One(B) .  hq,B2  =  0?  H1,B2  ^  0  *  Re~ 
ject  Hq  if  the  F*  ratio  is  greater  than  F  . 

Criterion  Test  One(A).  The  model  cannot  be  deemed  appropriate 
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unless  assumptions  about  constant  variance  of  residuals, 
residual  independence,  and  normal  distribution  of  residuals 
cannot  be  rejected  using  appropriate  tests. 

Criterion  Test  One(B).  The  model  cannot  be  deemed  appro- 

2 

priate  unless  the  R  (actual)  is  greater  than  80  percent. 

Model  4  Test  Results.  Test  results  for  research  hypothesis 
one  are  presented  in  Table  8  for  Model  4.  To  insure  under¬ 
standing,  the  model  and  its  variables  are  briefly  described 
as  follows : 


Reduced  Model: 


or  in  logarithmic  form: 

log(Yt)  =  log(B0)  +  Bx  *  log(X1). 


Full  Model: 


or  in  logarithmic  form: 

iog(Yt)  =  log(B0)+B1  ‘  log(X1)+B2  •  log(X2). 

where : 

Y^  represents  unit  cost  (total  direct  labor  hours/ 
equivalent  unit/accounting  month,  adjusted  for 
two  accounting  changes^), 


7 

As  described  in  the  data  collection  and  treatment 
section  of  Chapter  III. 
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TABLE  8 


RESEARCH  HYPOTHESIS  ONE 

RESULTS  FOR  ALLISON 

MODEL  4 

TESTED 

REDUCED 

FULL 

ITEMS 

MODEL 

MODEL 

Estimated  BQ 

Masked 

Masked 

Estimated  B^ 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

141 . 79 

169.65 

F  Critical  (2,  126) 

— 

3-07 

Statistical  Hypothesis  1A 

— 

Passed 

F* 

— 

92.68 

F  Critical  (1,  126) 

— 

3.92 

Statistical  Hypothesis  IB 

— 

Passed 

Criterion  Test  1A 

— 

Failed 

R2 

•  533 

.734 

R2 (Actual) 

.702 

.832 

Criterion  Test  IB 

Passed 

X1  represents  cumulative  output  as  of  the  last 
day  of  each  accounting  month,  and 
X2  represents  daily  average  production  rate/ 
accounting  month. 

The  results  depicted  in  Table  8  show  that  Model  4 
could  not  be  validated  for  further  testing  under  research 
hypothesis  four.  Both  the  full  and  the  reduced  forms  of 
the  model  proved  to  be  significant  explainers  of  the  varia¬ 
tion  in  the  dependent  variable,  and  the  addition  of  the  pro¬ 
duction  rate  variable  added  significantly  to  this  explana- 

p 

tory  ability.  Additionally,  the  R  (actual)  value  of  .832 
for  the  full  model  was  above  the  criterion  limit.  However, 
Model  4  failed  to  pass  the  tests  concerning  assumptions  of 
independence  and  normal  distribution  of  residuals.  The 
plot  of  residual  values  against  the  cumulative  output 
variable  revealed  a  strong  pattern,  as  depicted  in  Figure  1. 
In  this  pattern  the  residual  values  decreased  as  cumulative 
production  increased  to  the  100th  data  point,  then  jumped 
drastically  to  high  positive  values.  The  jump  coincided 
with  the  production  method  change  which  occurred  beginning 
with  data  point  101. 

Model  5  Test  Results.  Test  results  for  research  hypothesis 
:ne  are  presented  in  Table  9  for  Model  5-  For  clarification, 
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TABLE  9 


RESEARCH  HYPOTHESIS  ONE 

RESULTS  FOR  ALLISON 
MODEL  5 


TESTED 

ITEMS 

REDUCED 

MODEL 

FULL 

MODEL 

Estimated  BQ 

Masked 

Masked 

Estimated  B^ 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

454.86 

419-37 

F  Critical  (2,  126) 

— 

3-07 

Statistical  Hypothesis 

1A 

— 

Passed 

F* 

— 

83-02 

F  Critical  (1,  126) 

-- 

3-92 

Statistical  Hypothesis 

IB 

-- 

Passed 

Criterion  Test  1A 

— 

Failed 

R2 

.786 

.872 

R2 (Actual) 

.868 

•  919 

Criterion  Test  IB 


Passed 


the  model  and  its  variables  are  briefly  described  as  follows* 
Reduced  Model* 


or  in  logarithmic  form* 

log(Yt)  =  log(B0)  +  Bx  ’  log(X1). 
Full  Models 


or  in  logarithmic  form* 

log(Yt)  =  log(B0)  +  Bx  •  log(X1)  +  B2  ‘  log(X2). 

where  * 

represents  unit  cost  (total  direct  labor  hours/ 
equivalent  unit/accounting  month,  adjusted  for 

g 

two  accounting  and  one  production  method  changes' ) , 
X^  represents  cumulative  output  as  of  the  last  day 
of  each  accounting  month,  and 
X2  represents  daily  average  production  rate/account¬ 
ing  month. 

Model  5  results,  as  depicted  in  Table  9,  show  that 
the  model  passed  both  statistical  tests  and  one  criterion 
test  but  failed  the  criterion  test  concerning  assumptions 
about  residuals.  Consequently,  it  was  not  validated  for 


Q 

As  described  in  the  data  collection  and  treatment 
section  of  Chapter  III. 
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further  testing  under  research  hypothesis  four.  Model  5's 
failure  to  pass  criterion  test  one  (A)  was  due  to  the  re¬ 
jection  of  the  assumption  of  independence  of  residuals. 

As  with  Model  4,  the  plot  of  residual  values  against  the 
cumulative  output  variable  revealed  a  pattern  which  coin¬ 
cided  with  the  production  method  change  at  data  point  101. 
This  pattern  is  shown  in  Figure  2 .  The  pattern  was  less 
pronounced  than  with  Model  4,  because  data  used  in  Model  5 
were  transformed  to  compensate  for  the  production  method 
change.  The  fact  that  the  pattern  among  residuals  persisted 
highlighted  a  limitation  of  linear  regression  analysis  as 
performed  in  this  research.  Specifically,  breaks  in  pro¬ 
duction,  such  as  resulted  from  the  production  method  change 
in  the  TF-41  fabrication  process,  cannot  be  accommodated  by 
either  the  reduced  model  or  the  full  model.  Techniques 
using  a  zero-one  variable  in  the  regression  equation  can 
adequately  adjust  the  equation  to  compensate  for  the  effect 
of  a  production  break.  Application  of  such  techniques  is 
beyond  the  scope  of  this  research. 

THE  F-100  PROGRAM 

The  data  for  the  F-100  program  which  was  used  in 
this  research  covered  the  entire  production  history  of  the 
engine  to  date,  where  1090  units  were  produced  from  May  1973 
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FIGURE  2 


PLOT  OF  RESIDUALS  FOR  MODEL  5 
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to  January  1979*  No  breakout  between  fabrication  direct 
labor  and  assembly  and  test  direct  labor  was  available,  so 
analysis  of  the  explanatory  ability  of  the  appropriate  models 
was  limited  to  research  hypothesis  one.  All  direct  labor 
costs  were  provided  in  the  form  of  standardized  January  1976 
dollars.  As  with  the  TF-41  data,  the  availability  of  the 
entire  production  history  allowed  the  full  learning  curve 
effect  of  the  cumulative  output  variable  to  be  shown. 


Analysis  of  Research  Hypothesis  One 


The  statistical  hypotheses  and  criterion  tests  for 
research  hypothesis  one  are  restated  for  further  clarifi¬ 
cation,  followed  by  a  discussion  of  test  results  for  Model  6. 


Research  Hypothesis  One.  The  production  rate  variable  ex¬ 
plains  a  significant  portion  of  the  variation  in  total  direct 
labor  requirements  for  aircraft  engine  production  when  in¬ 
cluded  in  an  appropriate  model. 

Statistical  Hypothesis  One(A).  HQsB^  and  B2  =  °!  H1,B1  ^  0 
and/or  B2  /  0.  Reject  HQ  if  the  F  ratio  is  greater  than  Fc . 

Statistical  Hypothesis  One(B).  hqsB2  =  °l  BlsB2  ^  °*  Re~ 
ject  Hq  if  the  F*  ratio  is  greater  than  Fc . 

Criterion  Test  One (A).  The  model  cannot  be  deemed  appropriate 
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unless  the  assumptions  concerning  residuals  are  met. 


Criterion  Test  One(B) .  The  model  cannot  be  deemed  appropriate 
2 

unless  the  R  (actual)  is  greater  than  80  percent. 

Model  6  Test  Results.  Test  results  for  research  hypothesis 
one  are  presented  in  Table  10  for  Model  6.  The  model  and  its 
variables  are  briefly  described  as  follows: 


Reduced  Model: 


or  in  logarithmic  form: 

log(Yt)  =  log(B0)  +  B1  *  log(X1). 


Full  Model: 


or  in  logarithmic  form: 

log(Yt)  =  log(B0)  +  B1  '  log(X1)  +  B2  *  log(X2). 

where : 

Y^  represents  unit  cost  (total  direct  labor 
dollars/equivalent  unit/accounting  month), 

X-^  represents  cumulative  output  as  of  the  last 
day  of  each  accounting  month,  and 
X2  represents  daily  average  production  rate/month. 

The  results  depicted  in  Table  10  show  that  Model  6 
passed  both  statistical  tests  and  both  criterion  tests,  and 
was  validated  for  further  testing  under  research  hypothesis 


74 


TABLE  10 


RESEARCH  HYPOTHESIS  ONE 
RESULTS  FOR  PRATT  AND  WHITNEY 
MODEL  6 


TESTED 

ITEMS 

REDUCED 

MODEL 

FULL 

MODEL 

Estimated  BQ 

Masked 

Masked 

Estimated 

Masked 

Masked 

Estimated  B2 

Masked 

Masked 

F  Ratio 

215-51 

484.66 

F  Critical  (2,  64) 

— 

3.15 

Statistical  Hypothesis 

1A 

— 

Passed 

F* 

— 

169-18 

F  Critical  (1,64) 

— 

4.00 

Statistical  Hypothesis 

IB 

-- 

Passed 

Criterion  Test  1A 

-- 

Passed 

R2 

. 777 

.941 

R2  (Actual) 

.628 

.902 

Criterion  Test  IB 


Passed 


four.  F  ratio  tests  for  statistical  hypotheses  one(A)  and 
one(B)  were  significant  to  a  level  of  confidence  beyond  .001. 
Also  Model  6  passed  all  tests  on  the  assumptions  concerning 
the  residual  values.  The  R  (actual)  value  of  .90  was  well 
above  the  selected  criterion  of  .80  under  criterion  test 
one(B) . 

Analysis  of  Research  Hypothesis  Four 

The  computer  program  listed  in  Appendix  A  was  used 
to  perform  the  predictive  ability  test  on  Model  6.  The 
researcher  can  select  an  option  in  the  program  which  per¬ 
forms  stepwise  truncation  of  individual  data  points,  be¬ 
ginning  with  the  last  point  in  the  data  set  and  continuing 
in  reverse  sequence.  This  option  simulates  prediction  of 
direct  labor  requirements  for  each  truncated  data  point, 
then  compares  the  predicted  value  and  computes  the  resul¬ 
tant  difference  between  the  values,  both  as  an  absolute 
deviation  and  as  a  percent  deviation  from  the  observed 
value . 

In  this  research,  the  aforementioned  option  was 
exercised  for  the  Model  6  data,  truncating  the  last  12 
points  in  the  data  set.  A  summary  of  program  results  is 
depicted  in  Table  11,  showing  the  percent  deviation  of 
each  predicted  value  from  the  corresponding  observed  value, 
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TABLE  11 


SHORT  RANGE  PREDICTIVE  ABILITY  COMPARISON 
FOR  PRATT  AND  WHITNEY  MODEL  6a 


Data  Point 


Reduced 

Model 


Full 

Model 


Percent  Percent 

Deviation  Deviation 


64 

9-67 

-I.63 

63 

7.01 

-5-28 

62 

-2.07 

0.24 

61 

19-36 

-2.42 

60 

7.29 

-1.59 

59 

8.17 

-2.26 

58 

9*07 

1.07 

57 

14.31 

2.14 

56 

11.63 

-3.17 

55 

9.11 

5-59 

54 

8.68 

-1.06 

53 

IO.63 

11.44 

aThe  first  52  of  the  64  values  in  the  data  set 
were  used  in  the  regression  to  predict  the  last  12  values. 
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for  each  of  the  12  truncated  data  points,  for  both  the  full 
and  reduced  models.  In  this  manner  the  prediction  of  direct 
labor  requirements  for  the  most  recent  12  months'  production 
was  simulated,  using  the  production  history  of  the  engine 
with  those  final  12  data  points  deleted.  It  must  be  noted 
that,  to  compute  the  aggregate  (12 -month)  deviation  values 
for  the  full  and  reduced  models,  the  monthly  deviations 
shown  in  Table  11  were  weighted  in  proportion  to  the  number 
of  units  completed  during  each  month. 

Research  Hypothesis  Four.  For  twelve  months  into  the  future, 
the  predictive  ability  of  the  full  model  is  better  than  the 
predictive  ability  of  the  reduced  model. 

Statistical  Hypothesis  Four.  HQs  I  DRI  <  I  Dpi  j  H^«l  DRI>I  Dpi  . 
Reject  Hq  if  t>t  (.05). 

Criterion  Test  Four.  The  full  model  is  considered  of  prac¬ 
tical  value  if  its  12 -month  aggregate  deviation  is  subjec¬ 
tively  judged  to  be  (1)  sufficiently  smaller  than  that  of 
the  reduced  model,  and  (2)  sufficiently  small  in  an  absolute 
sense . 

Model  6  Test  Results.  As  depicted  in  Table  12,  Model  6 
passed  both  the  statistical  test  and  the  criterion  test, 
and  was  consequently  judged  to  be  a  better  predictor  than 


TABLE  12 

RESEARCH  HYPOTHESIS  FOUR 

RESULTS  FOR  PRATT  AND  WHITNEY 
MODEL  6 


TESTED  REDUCED  FULL 

ITEMS  MODEL  MODEL 


Average  Absolute  Deviation  5144.81 
Variance  7,849,467.56 

t  Test  Statistic  - 

t  Critical  - 


32  52 . 98 
6,687,281.06 
8.93 
1.80 


Statistical  Hypothesis  Four  Result 


Reject  Hq 


Percent  Deviation  from 

Actual  12 -Month  8.48 

Direct  Labor  Figure 


■32 


Criterion  Test  Four  Result  Passed 

_ 
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the  reduced  model.  The  t-test  results  were  significant 
beyond  the  .001  level  of  confidence,  yet  the  most  impres¬ 
sive  performance  of  the  full  model  was  in  its  evaluation 
using  the  criterion  test.  In  this  test  the  full  model's 
accuracy  in  predicting  the  direct  labor  costs  for  the 
most  recent  12  months  of  production  was  found  to  be  within 
one-third  of  one  percent  of  the  actual  value,  while  the 
reduced  model’s  prediction  deviated  from  the  actual  by 
more  than  eight  percent.  The  inescapable  conclusion  was 
that  the  full  model  was  not  only  a  better  predictor  than 
the  reduced  model,  but  was  of  strong  practical  value. 

COMPARATIVE  ANALYSIS  AND  SUMMARY 

The  regression  analysis  with  the  three  sets  of 
engine  production  data  produced  three  distinctly  different 
results.  A  comparative  analysis  of  the  J-79.  TF-41,  and 
F-100  engine  data  and  production  programs  will  investigate 
these  differences.  A  summary  and  evaluation  of  the  appli¬ 
cability  of  the  production  rate  model  to  the  three  sets  of 
data  will  then  complete  Chapter  IV. 

Comparative  Analysis 

A  thorough  analysis  of  the  results  of  the  hypothesis 
testing  described  in  this  chapter  revealed  two  significant 
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findings  concerning  applicability  of  the  models  tested. 

The  first  was  that  the  tremendous  complexity  of  modem 
aircraft  engine  production  programs  limited  the  applica¬ 
bility  of  the  learning  curve  in  either  its  reduced  or  full 
form.  The  second  was  that  a  substantial  portion  of  the 
production  history  must  be  included  in  a  data  set  in  order 
to  effectively  measure  the  applicability  of  the  appropriate 
models.  These  two  findings  will  now  be  discussed. 

Program  Complexity.  Modem  aircraft  propulsion  systems  are 
composed  of  thousands  of  parts,  many  of  which  are  precision 
tooled,  complex  in  nature,  and  fabricated  from  advanced  alloys. 
Many  parts  are  common  to  several  programs?  others  are  unique. 
Additionally,  a  mature  production  program  often  produces 
several  engine  models,  each  differing  in  varying  degrees 
from  the  others.  The  extensive  nature  of  the  fabrication 
and  assembly  tasks  involved  in  the  process  affords  manage¬ 
ment  constant  opportunity  to  alter  make-or-buy  policies 
and  in-plant  production  methods.  This  dynamic  state  of 
production  places  in  potential  jeopardy  the  assumptions 
critical  to  the  successful  application  of  the  learning 
curve  which  were  stated  in  Chapter  I. 

The  TF-41  program  underwent  numerous  changes 
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throughout  its  production  history,  including  the  two  account¬ 
ing  changes  and  the  major  production  method  change  described 
in  the  data  collection  and  treatment  section  of  Chapter  III. 

The  periodic  minor  changes  to  improve  production  methods 
were  anticipated  by  the  model  and  were  an  important  part 
of  the  learning  process j  however,  the  major  production  method 
change  had  an  adverse  impact  on  the  applicability  of  the  model, 
and  in  fact  caused  the  failure  of  both  Model  4  and  Model  5 
under  research  hypothesis  one.  The  data  transformation 
performed  in  the  Model  5  analysis  to  account  for  the  pro¬ 
duction  method  change  did  improve  the  results  in  comparison 
to  Model  4’s,  but  was  not  sufficient  to  allow  the  model  to 
pass  the  test  of  the  assumption  of  independence  of  residuals. 
The  production  method  change  had  introduced  an  anomaly  in 
direct  labor  costs  which  the  full  and  reduced  models  of 
the  learning  curve  could  not  adequately  explain.  This 
anomaly  caused  the  residual  values  to  appear  to  be  depen¬ 
dent  upon  the  cumulative  units  of  production,  which  in 
turn  caused  Model  5's  rejection  under  research  hypothesis 
one.  Yet,  even  if  the  model  had  somehow  been  validated 
under  research  hypothesis  one,  it  would  still  have  failed 
the  criterion  test  under  research  hypothesis  four  due  to 
a  full  14  percent  deviation  from  the  12 -month  aggregate 
actual  direct  labor  costs.  This  large  deviation  was 
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another  effect  of  the  production  method  change. 

The  other  two  data  sets  did  not  reflect  the  same 
impact  of  program  complexity,  for  differing  reasons.  The 
F-100  program  was  relatively  new  with  no  major  program 
changes.  The  J-79  data  set  was  at  the  end  of  a  lengthy 
production  run,  where  any  major  program  changes  had  already 
occurred. 

Production  History.  The  discussion  on  program  complexity 
in  the  preceding  section  reflected  the  hazards  of  utilizing 
program  data  from  the  most  dynamic,  substantial  portion  of 
the  production  program.  However,  this  research  also  high¬ 
lights  the  importance  of  obtaining  data  from  a  major  portion 
of  the  production  program  in  order  to  capture  the  full  learn¬ 
ing  curve  effect. 

Problems  encountered  in  analyzing  the  applicability 
of  the  appropriate  learning  curve  models  to  a  small  segment 
of  production  data  were  shown  in  the  analysis  of  the  J-79 
program.  The  only  J-79  data  available  for  analysis  in  this 
research  was  a  five-year  segment  near  the  end  of  the  produc¬ 
tion  program,  which  included  the  last  900  units  of  an  approxi¬ 
mate  14,000  unit  program.  Viewed  graphically,  this  was  a 
nearly  horizontal  segment  of  the  entire  production  history 
learning  curve.  As  a  result,  the  amount  of  variation  in 
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direct  labor  costs  which  was  explained  by  the  learning 
curve  effect  was  not  a  significant  improvement  over  the 
amount  explained  by  the  simple  arithmetic  average.  Of 
interest  was  that  for  the  J-79  program,  the  production 
rate  independent  variable  alone  was  a  statistically  signi¬ 
ficant  explainer  of  variation  in  total  direct  labor  costs. 
However,  considering  the  negligible  effect  of  the  cumula¬ 
tive  output  independent  variable,  the  overall  explanatory 
ability  of  the  model  was  unacceptably  low.  In  contrast, 
the  F-100  and  TF-41  data  encompassed  the  entire  histories 
of  the  programs ,  and  in  both  cases  the  effect  of  the  learn¬ 
ing  curve  was  prominent. 

Summary 

The  preceding  analyses  of  the  three  aircraft  engine 
production  programs  were  based  on  the  methodology  and  data 
treatment  as  explained  in  Chapter  III.  Research  hypothesis 
one  was  only  accepted  for  Model  6  using  the  F-100  data  set, 
and  research  hypotheses  two  and  three  were  not  accepted  for 
the  models  tested.  The  production  rate  variable  was  an 
important  explainer  of  variation  in  direct  labor  costs  for 
three  of  the  six  models  evaluated.  The  increase  in  R  (actual) 
was  greater  than  5  percent  in  five  of  the  models  as  shown 
in  Table  13*  The  failure  of  the  J-79  and  TF-41  program 


TABLE  13 

INCREASES  IN  R2 (ACTUAL)  FOR  ALL  SIX  MODELS 
TESTED  AFTER  INCLUSION  OF  PRODUCTION  RATE 


MODEL 


R 

REDUCED 


R 

FULL 


A  H 


models  to  be  accepted  under  any  of  the  first  three  research 
hypotheses  was  due  to  program  complexity  and  insufficient 
production  history  respectively,  as  discussed  in  the  pre¬ 
ceding  section  of  this  chapter. 

Model  6,  developed  for  the  F-100  data  set,  was  also 
accepted  under  research  hypothesis  four.  Not  only  was  the 
predictive  ability  of  the  full  model  statistically  greater 
than  that  of  the  reduced  model  at  the  .05  level  of  signi¬ 
ficance,  but  the  superiority  of  the  full  model  was  also 
clearly  demonstrated  by  the  subjective  criterion  tests. 

The  analysis  of  the  J-79,  TF-41,  and  F-100  engine 
production  programs  performed  in  this  research  thus  met  the 
research  objectives  of  determining  the  effect  of  production 
rate  changes  on  production  direct  labor  requirements  and 
evaluating  the  predictive  ability  of  a  cumulative  produc¬ 
tion  and  production  rate  model.  Of  the  three  engines, 
only  the  F-100  engine  passed  all  the  tests. 
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CHAPTER  V 


SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 

Inflation,  energy  shortages  and  other  current 
economic  forces  have  more  sharply  focused  the  attention 
of  the  American  public  on  the  manner  in  which  tax  dollars 
are  spent.  This  public  pressure  for  reduced  government 
spending  has  been  directed  extensively  toward  major  system 
acquisitions  by  the  Department  of  Defense,  in  part  due  to 
the  high  visibility  of  these  sytems  caused  by  the  Congres¬ 
sional  budgetary  process. 

The  reduction  of  the  DOD  budget  in  real  terms  during 
a  time  of  greater  complexity  and  expense  of  major  defense 
systems,  combined  with  the  strong  public  scrutiny  as  to 
how  the  budget  is  spent,  points  to  the  critical  need  for 
improved  cost  estimating  techniques  and  procedures.  Direct 
labor  costs  drive  a  substantial  portion  of  total  major  system 
acquisition  costs,  making  direct  labor  a  key  cost  element. 

The  learning  curve  is  often  employed  to  estimate  direct 
labor  costs. 


LITERATURE  REVIEW 

Learning  curve  models  have  served  as  techniques  for 
estimating  direct  labor  costs  since  their  development  in 
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the  aerospace  industry  of  the  World  War  II  era.  Following 
the  introduction  of  the  basic  learning  curve  model,  several 
variations  were  developed  in  a  continuing  quest  for  greater 
accuracy  in  cost  forecasting.  The  most  promising  of  these 
variations  has  been  the  production  rate  model. 

Most  researchers  who  studied  the  effect  of  produc¬ 
tion  rate  changes  concluded  that  the  production  rate  was  a 
significant  explainer  of  direct  labor  costs.  The  most 
conclusive  of  these  studies  was  that  performed  by  Smith, 
who  developed  a  generally  accepted  technique  for  estimating 
airframe  direct  labor  requirements  which  systematically 
employed  a  production  rate  variable  in  the  learning  curve 
model.  Smith's  production  rate  model  focused  on  airframes; 
this  research  extended  the  investigation  of  production  rate 
from  airframes  to  aircraft  engines. 

THE  MODEL 

Smith's  production  rate  model,  replicated  by 
Congleton  and  Kinton,  was  a  modification  of  the  model  devel¬ 
oped  by  Orsini.  The  full  model  used  in  this  research,  an 

adaptation  of  Smith's  model,  is  as  follows: 

Bn  Bp  p 
Y  =  Bq  •  X1‘L  ’  *  10e 

where  the  variables  are  described  in  general  terms  as  follows: 


Y  represents  the  unit  average  direct  labor  hours 
(or  proxy), 

represents  the  cumulative  output  of  engines  or 
equivalent  units, 

Xg  represents  the  production  rate, 
e  represents  the  variation  which  is  left  unex¬ 
plained  by  the  variables  in  the  model,  and 
Bq,  ,  and  B2  are  regression  coefficients. 

The  logarithmic  form  of  the  full  model  is* 

log  Y  =  log  Bq  +  B1  log  X^  +  B2  log  X2  +  e. 

The  reduced  model  used  in  this  research  is  the  basic  learn¬ 
ing  curve  model,  identical  tc  the  full  model  both  before 
and  after  transformation  to  logarithmic  form,  except  the 
reduced  model  does  not  include  the  production  rate  variable. 

RESEARCH  OBJECTIVES 

The  two  primary  objectives  of  this  research  were 

(1)  to  determine  if  changes  in  the  rate  of  production 
affect  total  direct  labor  requirements  per  engine,  and 

(2)  to  determine  if  the  production  rate  model  was  better 
than  the  basic  learning  curve  model  in  predicting  direct 
labor  requirements  for  aircraft  engine  production. 
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METHODOLOGY 


The  methodology  designed  to  meet  the  research 
objectives  was  based  on  linear  regression  of  the  logarithmic 
forms  of  the  full  and  reduced  models.  Data  for  use  in  the 
regression  analysis  were  obtained  from  three  aircraft  engine 
production  programs.  Each  data  set  contained  unique  aspects 
requiring  individual  treatment  as  described  in  Chapter  III, 
and  specific  models  for  regression  were  developed  for  each 
data  set.  Models  were  analyzed  to  determine  first  if  the 
production  rate  was  an  important  explainer  of  direct  labor 
hours,  and  if  so,  whether  the  full  model  was  a  better  pre¬ 
dictor  of  direct  labor  hours  than  the  reduced  model.  The 
hypotheses  which  comprised  these  steps  are  described  next. 

Research  hypothesis  one  stated  that  production 
rate  was  an  important  explainer  of  total  direct  labor  hours 
when  included  in  an  appropriate  model.  Two  statistical  tests 
were  employed.  First,  the  F-test  was  used  to  determine  if 
a  relationship  existed  between  the  dependent  variable  and 
the  independent  variables,  cumulative  output  and  production 
rate.  Next,  the  F-test  was  again  used  to  determine  if  the 
production  rate  was  significant  in  explaining  additional 
variation  in  the  dependent  variable. 

Following  the  two  statistical  tests,  two  criterion 
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tests  were  performed.  The  first  criterion  test  evaluated 
the  assumptions  of  constant  variance  of  residuals,  residual 
independence,  and  normal  distribution  of  residuals,  three 
assumptions  which  were  necessary  for  the  model  to  be  deemed 
appropriate.  The  second  criterion  test  required  R  (actual) 
to  exceed  80  percent,  an  arbitrary  measure  of  the  model's 
ability  to  explain  a  sufficient  amount  of  variation  in  the 
dependent  variable.  Models  which  passed  both  statistical 
and  both  criterion  tests  were  validated  for  further  testing 
under  research  hypothesis  four. 

Research  hypotheses  two  and  three  were  identical 
to  research  hypothesis  one,  except  that  direct  fabrication 
labor  requirements  and  assembly  and  test  labor  requirements 
respectively  were  substituted  for  total  direct  labor  require¬ 
ments.  As  in  research  hypothesis  one,  models  were  required 
to  pass  both  statistical  and  both  criterion  tests  in  order 
to  be  validated  for  further  testing  under  research  hypo¬ 
thesis  four. 

Tests  under  research  hypothesis  four  were  used  to 
measure  and  compare  the  predictive  abilities  of  the  full 
and  reduced  forms  of  a  model  which  passed  the  tests  of 
explanatory  ability  just  described.  A  statistical  test 
and  a  criterion  test  were  used  in  this  procedure,  whereby 
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the  last  12  months,  or  data  points,  in  the  data  set  were 
truncated,  and  the  remaining  data  points  were  used  in  a 
simulation  to  predict  these  12  points.  In  the  statistical 
test  the  t-test  was  used  to  determine  if  the  average  abso¬ 
lute  deviation  of  the  full  model  was  significantly  less  than 
that  of  the  reduced  model.  Then  the  criterion  test  compared 
the  aggregate  12-month  deviation  of  the  two  models  in  a  test 
of  practical  significance. 

With  the  exception  of  the  tests  performed  on  assump¬ 
tions  of  residuals  and  the  subjective  evaluation  of  practical 
importance  in  criterion  test  four,  all  test  results  were  ob¬ 
tained  through  use  of  the  computer  program  PRODRATE  listed 
in  Appendix  A. 

CONCLUSIONS 

Two  primary  conclusions  were  reached  in  the  accom¬ 
plishment  of  the  objectives  of  this  research.  Production 
rate  was  found  to  be  a  significant  explainer  of  variation 
in  direct  labor  hours  in  three  of  the  six  cases  examined. 

Thus,  the  production  rate  variable  may  or  may  not  be  a 
significant  explainer,  depending  upon  the  particular  pro¬ 
gram.  In  the  one  case  where  the  test  of  predictive  ability 
was  subsequently  performed,  the  full  model  was  found  to  be 


a  much  better  predictor  than  the  reduced  model.  This  result 
demonstrates  that  the  full  model  has  potential  to  be  a  much 
better  predictor  than  the  reduced  model,  again  depending 
upon  the  particular  program. 

Several  additional  conclusions  were  reached,  each 
of  which  will  now  be  discussed.  The  first  additional  con¬ 
clusion  is  that  the  complexity  of  aircraft  engine  production 
programs  limits  the  applicability  of  use  of  either  the  full 
or  reduced  models  used  in  this  research.  The  large  number 
of  parts  in  an  aircraft  engine  affords  management  constant 
opportunity  to  alter  make-or-buy  policies  and  in-plant  pro¬ 
duction  methods.  Additionally,  model  changes  can  frequently 
occur.  These  policy  and  model  changes  can  impact  the  pro¬ 
duction  history  in  such  a  way  that  neither  the  full  nor  re¬ 
duced  model  is  an  appropriate  best  explainer  of  variation. 

In  this  research,  problems  were  encountered  in 
analyzing  the  applicability  of  the  appropriate  learning 
curve  models  when  using  a  relatively  small  segment  of  total 
program  production  data.  The  second  additional  conclusion 
is  that  the  engine  production  data  must  include  a  substan¬ 
tial  percentage  increase  in  cumulative  units  of  production 
in  order  to  capture  the  full  effect  of  the  learning  curve. 
Only  in  this  way  can  the  full  and  reduced  models  be  found 
appropriate  to  the  data. 
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Coefficients  resulting  from  each  regression  analysis 
performed  were  unique  to  that  particular  data  set.  These 
results  can  be  generalized  into  the  obvious  conclusion 
that  the  regression  coefficients  are  unique  to  the  pro¬ 
gram  for  which  they  were  derived.  Thus  the  third  additional 
conclusion  is  that  it  is  not  possible  to  develop  a  general 
model  for  use  in  all  aircraft  engine  production  programs. 

RECOMMENDATIONS 

In  view  of  the  results  obtained  for  the  F-100  engine 
production  program,  the  most  obvious  recommendation  is  that 
the  production  rate  model  be  applied  in  actual  direct  labor 
cost  estimating  for  this  program.  A  second  and  related 
recommendation  is  that  the  production  rate  model  be  evalu¬ 
ated  for  possible  use  in  other  ongoing  engine  production 
programs.  A  third  recommendation  is  to  extend  the  scope 
of  this  research  outward  to  other  major  production  programs, 
to  investigate  the  applicability  of  the  production  rate 
model  to  production  of  missiles  and  other  major  systems. 

An  additional  area  for  extensive  research  which 
was  mentioned  briefly  in  this  analysis  is  the  adaptation 
of  the  model  to  accomodate  changes  in  production  methods 
and/or  policy.  Progress  in  this  area  would  greatly  extend 
the  applicability  of  the  model. 


In  final  conclusion,  the  production  rate  model  as 
developed  by  Smith  has  tremendous  potential  as  a  tool  for 
cost  estimating  in  selected  aircraft  engine  production 
programs . 
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APPENDIX  A 

THE  COMPUTER  PROGRAM  PRODRATE 
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This  section  lists  the  computer  program  PRODRATE. 
The  original  program,  developed  by  Lt.  Col.  Larry  L.  Smith 
was  modified  by  Capt.  David  Stevens.  This  modified  version 
the  cumulative  production  and  production  rate  cost  model, 
was  further  modified  for  this  research  in  order  to 
accommodate  the  aircraft  engine  data.  The  actual  program 
used  in  this  research  is  the  program  presented  in  this 
section. 
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PROGRAM  ARE :“,//, 

1.  REDUCED  KOOa  [STANDARD  LEARNING  CURVE  MODEL]".//. 

T  =  B3  ♦  111  »  BI)  *  (10  •«  El".//. 

2.  FULL  MODEL  [CUMULATIVE  PRODUCTION  AND  PRODUCTION  RATE  MODEL!".//. 

T  *  B8  *  III  «  Bl)  *  (12  »♦  B2I  »  (18  *i  El"./7. 

WERE:  T  IS  THE  DIRECT  LABOR  REQUIREMENTS"./. 

11  IS  THE  CUMULATIVE  PRODUCTION  PLOT  POINT",/, 

12  IS  THE  PRODUCTION  RATE  PKOIUE.G.  EQUIVALENT  UNITS  PER  HONTH)*,/, 

E  REPRESENTS  THE  ERROR  TERM",/, 

B8,  Bi,  AND  B2  ARE  PARAMETERS  DETERMINED  BT  REGRESSION",//, 

DATA  ARE  INPUT  BT  READING  FROM  ANT  PROPERLT  FORMATTED  DATA  FILE.  TOUR  DATA  FILE  SHOULD  ",/, 
BE  SAVED  TO  ANT  PERMANENT  FILENAME.  TOU  WILL  BE  ASK  TO  INPUT  THE  NAME  OF  TOUR  DATA  FILE  “,/, 

AT  THE  APPROPRIATE  STEP  IN  THE  PROGRAM.  THE  NAME  OF  TOUR  DATA  FILE  CAN  NOT  E1CEED  8  ">/, 
CHARACTERS.  THE  FIRST  LINE  OF  THE  DATA  FILE  MUST  CONTAIN  A  LINE  NUMBER  AND  THE  NUMBER  CF  ■</, 
CASES  TO  BE  READ.  THE  DATA  IS  THEN  ENTERED  ONE  CASE  PER  LINE  IN  THE  FOLLOHIHC  ORDER:  ",/, 

LINE  NUMBER,  OBSERVED  DIRECT  LABOR  KEOUIREMENT  <T),  CUMULATIVE  PRODUCTION  PLOT  POINT  «»,*,/, 

AND  PRODUCTION  RATE  PRCXT  (12).  THE  PROCRAM  USES  A  FREE  FIELD  READ  FORMAT!  THEREFORE,",/, 

EACH  VARIABLE  MUST  BE  SEPARATED  BT  AT  LEAST  ONE  SPACE  IOR  OTHER  DELIMITER)  BUT  NO  OTHER",/. 
SPECIAL  FORMAT  IS  REQUIRED.  AN  EIAMPLE  OF  A  DATA  FILE  WITH  5  CASES  IS  PRESENTED  BELOW:",//, 


13981 

II 

10! 

5",/, 

14880 

m 

181 

188 

9.5 

9.5",/, 

14184 

u 

182 

90 

38 

28.5*,/, 

14281 

N 

183 

98 

55 

25",/, 

14384 

■ 

184 

75 

82 

27",/, 

14484 

II 

185 

71 

113 

31",//, 

“  ONE  ADVANTACE  OF  THIS  PROCRAM  IS  THAT  THE  RESULTS  OBTAINED  HILL  BE  IN  THE  SAME  UNITS  AND",/, 

"  FORM  AS  THE  INPUT  DATA.  FOR  EIAMPLE,  IF  YOU  ARE  WORKING  IN  DIRECT  LABOR  HOURS  PER  MONTH"./, 

"  AND  EQUIVALENT  UNITS,  THE  RESULTS  HILL  BE  IN  TERMS  OF  THESE  UNITS.  ALSO.  IF  TOU  WISH  TO  USE"./, 
“  A  CUMULATIVE  AVERAGE  APPROACH,  ALL  TOU  NEED  00  IS  ACWSEGATE  THE  DATA  BASE  IN  THAT  MANNER.",//, 

"  THE  PROGRAM  BEGINS  ET  TRANSFORMING  THE  INPUT  DATA  TO  COMMON  LOGARITHMS.  LOG  LINEAR",/, 

•' EGRESSION  IS  THEN  PERFORMED  AS  FOLLOWS:  T  RECRESSEO  ON  II,  T  REGRESSED  ON  12,  ANO",/. 

-LLT  T  RECRESSEO  ON  BOTH  It  ANO  12.  OBSERVED  DIRECT  LABOR  REQUIREMENTS,  PREDICTED",/, 
tCT  LABOR  REQUIREMENTS,  AND  RESIDUALS  ARE  FRINTED  IN  ORIGINAL  IUNTRANSPORMEOI  PORN  FOR",/, 

A  REGRESSION  SITUATION.  IN  ADDITION,  SUMMART  STATISTICS  ARE  FRINTED  FOR  EACH  MODEL.  THE",/, 
-..-MART  STATISTICS  INCLUDE  THC  COEFFICIENTS  OF  DETERMINATION  R  SQUARED  LOG  AND  K  SQUARED",/, 

-  iCTUAL.  THE  R  SQUARED  LOG  REPRESENTS  THE  CCOCAESS  OF  FIT  OF  THE  MODEL  TO  THE  TRANSFORMED",/, 

'•  DATA  (LOG  FORM).  THE  R  SQUARED  ACTUAL,  ON  THE  OTHER  HAND.  IS  COMPUTED  USING  THE",/, 

“  UNTRANSFORMED  RESIDUALS,  AND  IS  REPRESENTATIVE  OF  HGH  HELL  THE  MODEL  FITS  THE  UNTRANSFORMED",/, 

*  BATA.") 


159*  4  'QfiRATIlHMI,//, 

14004  "  SEVERAL  OPTIONS  ARE  AVAILABLE  WITHIN  THIS  PROCRAH  AND  CAN  EE  SaECTED  ST  APPROPRIATE"./. 
U104  "  MSUERS  TO  THE  FOLLOW  INC  CUESTIONS:".//. 


14204  "  1.  00  TOO  HANT  TO  CHECK  DATA  AS  IT  IS  REAO  FROM  FILE .  .AND  CON  VETTED  TO"./. 

14334  *  LOCARITHHS?".//. 

14404  *  TES  -  HILL  CAUSE  THE  FRIHTINC  OF  A  LISTING  OF  THE  RATIONAL  INPUT  DATA  AND  THE"./. 

14504  *  ASSOCIATED  LOGARITHMIC  VALUES.".//. 

IU04  *  NO  •  SUPPRESSES  THIS  OPTION. 

14704  *  2.  DO  TOU  HANT  A  COMPARISON  OF  THE  SHORTRANCE  PREDICTIVE  ABILITT  OF  THE  TNO  MODELS?".//. 

14SC4  “  TES  -  HILL  CAUSE  THE  PREDICTIVE  ABILITT  TEST  OPTION  TO  BE  ACTIVATED  AND  THE  USER  WILL*./. 

14 904  ■  BE  ASKED:  'HON  PANT  CASES  DO  TGU  WISH  TO  TRUNCATE?'  THE  RESPONSE  TO  THIS*./. 

17004  *  QUESTION  HAT  BE  ANT  INTEGER  VALUE  GREATER  THAN  OS  EQUAL  TO  2.  THE  PREDICTIVE",/. 

17104  *  ABILITT  TEST  SIMULATES  FUTURE  PREDICTIONS  BT  PERFORMING  A  STEPWISE  TRUNCATION  OF',/. 

172C4  *  THE  HISTORICAL  DATA.  FCR  THIS  REASON,  AN  UPPER  LIMITATION  ON  THE  NUMBER  OF*,/, 

17304  '  CASES  TRUNCATED  WOULD  BE:  ((TOTAL  NUMSER  OF  CASES  IN  DATA  rILE)  /  2)  -  2",/, 

17404  “  FOR  ETAMPLE.  IF  TOUR  DATA  FILE  CONTAINS  50  CASES,  TOUR  UPPER  LIMIT  HOULD  BE",/, 

17504  "  23  CASES.  THIS,  OF  COURSE,  REPRESENTS  ONLT  THE  MAXIMUM  NUMBER  OF  CASES  THAT*,/, 

17404  *  COULD  BE  TRUNCATED.  IN  PRACTICE  TOU  NAT  HANT  TO  TRUNCATE  ONLT  A  SHALL  NUMBER  OF*,/, 

17704  *  CASES.  THUS.  IF  TOUR  DATA  IS  COLLECTED  IN  NONTHU  INTERVALS,  TOU  CAN  LOOK  AT",/, 

17804  *  THE  PREDICTIVE  ABILITT  OF  THE  FULL  AND  REDUCED  MODELS  FOR  AN  16  MONTH  TINE  SPAN  8T“>/, 

17904  "  SPECIPTINC  MB'.  LIKEWISE.  IF  TOUR  DATA  IS  COLLECTED  IN  QUARTERS,  TOU  CAN  LOOK",/, 

18004  *  AT  THE  PREDICTIVE  ABILITT  OF  BOTH  MODELS  FOR  AS  18  MONTH  TIME  SPAN  BT  SPECIFTINC',/, 

18104  *  '4'.  AFTER  ALL  PREDICTIVE  ABILITT  TEST  SITUATIONS  ARE  PRINTED,  THE  PROGRAM"./, 

18204  "  PRINTS  A  SUHNART  OF  THE  TEST  RESULTS.",//, 

18304  "  NO  -  SUPPRESSES  THIS  OPTION.",//, 

18404  "  3.  DO  TOU  HANT  PROJECTION  AND  SENSITIVE  HATRII?*,//, 

18504  “  TES  -  HILL  CAUSE  PRINTINC  OF  PROJECTION  AND  SENSITIVITT  MATRIX.  THIS  MATRIX  FRESENTS",/, 

18404  "  PROJECTED  DIRECT  LABOR  RESUIREHENTS  FOR  SELECTED  PAIRS  OF  CUMULATIVE  PRODUCTION", /, 

18704  "  PLOT  POINTS  AND  PRODUCTION  RATES.  THE  PROJECTION  INTERVAL  FOR  THE  CUMULATIVE”,/, 

18806  *  PRODUCTION  PLOT  POINT  IS  II  OF  THE  LAST  OBSERVED  VALUE.  THE  PROJECTION  VALUES*,/, 

18904  *  FOR  PRODUCTION  RATE  ARE  70,  SB,  9B,  IBB,  110,  120,  130,  140,  AND  ISO  PERCENT  OF',/, 

19004  *  THE  LAST  OBSERVED  VALUE  OF  PRODUCTION  RATE.',//, 

19104  "  NO  -  SUPPRESSES  THIS  OPTION. “I 
1920C 
1 93/C 

IS50C  DIMENSIONING  VARIABLES 

HWCHIItmmmiHIIIHHIIIHIHHHHiMiHtlHmHKHHIHmHHMIMKHIIHHIiHIHHIlWII 

1970  ALPHA  ANSHERI10) 

1980  FILENAME  DATAFILE 

1990  DIMENSION  PL0TU58) , RATEU50). MKSI150) >111531, II (150),  12(1511  .LNU50I. 

28034  NtUPLCT (1501 -PRORATE (15) ,FVRS( 153, 15) ,ADEVR (9991 ,AOEVF (9991 

2313  DATA  SUMHRS,SUMIl,SUMU,SUKT,SSII,SSI2,SUMItT,SUni2r,SMUI2, 

23204  SSE-SSE1, SSE2 ,SSEL>  SSEL 1 , SSEL2 , SSTO , SSTG1 »SST02 , SSTOL , SSTOL 1 , SSTOLZ/Z 1 *0/ 

2040C 

2050C  PART  I  -  BEGIN  PROCRAH,  INSTRUCTIONS,  DATA  INPUT,  DATA  TRANSFORMATION,  AND  OPTION  SELECTIONS. 
2340C 

IlHCHHiHtHttiMiHttHiHitiHtitiHHmtHumimHittmtHitmiHHinimHiHitmHimm 
2.80  PRINT,'  THE  CUMULATIVE  PRODUCTION  AND  PRODUCTION  RATE  COST  NOOEL' 

239BC:::::: 

2 HOC  INSTRUCTIONS  OPTION  SELECTION 

21 WC:::::: :::::: ::::::  1 1 :  i ::::::::::::::::::  s :::  i :::: :  t ::::::  s ::::::  i ::::::  j  :::::: 


2121  PRINT,"  " 

2121  PRINT  II 

214*  II  FORMAT (II, "DO  TOU  KANT  INSTRUCTIONS?",//) 

2151  III  INPUT,  ANSWER! 1)  . 

2UI  IF  IANSUER(I).EO."NO")  CO  TO  112 
2171  IF  (ANSWER!!) .Efl."TES")  CO  TO  111 

2181  PRINT,"  ANSWER  IES  OR  NO  GNlf  PLEASE" 

2191  PRINT,"  " 

2 'll  CO  TO  111 

2211  111  PRINT  5 

2221  PRINT  I 

2231  PRINT  71 

22410::::::::"::::::::::: A::::::::::;::::::::::::::::::: it!!:::::: 
2250C  INPUT  THE  DATA  ANO  TRANSFORM  THE  VARIABLES  TO  LOCARITHNS 
22S8C: ::>:::: :::::::: :::::::::::::::::::: ::: 
227IC 

2281  112  PRINT  21 

2291  21  FORMAT (II, "PLEASE  ENTER  THE  NAME  OF  TOUR  DATA  FILE",//) 

23 II  INPUT,  DATAFILE 

2311  READ(DATAFILE>25)LN(1) iNCASES 

2321  25  FORMAT (V) 

2331  DO  38  UUNCASES 

2348  READ (DATAFILE , 25) LN ( I ) • HRS ( I ) .PLOT ( I ) ,RATE ( I I 

2358  HI)  =  ALCCIKHRS!!)) 

2348  11(1)  «  ALOClKPLOTdll 

2371  12(1)  ;  ALOCIKRATE(I)) 

2381  SUNHRS  »  SUNHRS  *  HRSII) 

239i  Siam  •  soim  ♦  nm 


::::::::::::: 


2298  21  FORMAT (II, "PLEASE  ENTER  THE  NAME 

2388  INPUT,  DATAFILE 

2311  READ (DATAFILE, 25)LN(1),NCASES 

2321  25  FORMAT (V) 

2338  DO  38  I  >  UNCASES 

2348  READ (DATAFILE , 25) LN ( I ) • HRS ( I ) ,PL 

2358  T(I)  =  ALCCIKHRS!  II) 

2348  11(1)  :  ALOClKPLOTdll 

2371  12(1)  ;  AL0C1KRATE(I)I 

2381  SUNHRS  »  SUNHRS  ♦  HRSII) 

239i  sumi  •  sunn  ♦  nm 

2438  SUNK  >  SUNK  ♦  12(1) 

2418  SUNT  *  SUNT  ♦  Td) 

2421  SSI1  *  SSIt  ♦  Il(!)4»2 

2431  SSI2  *  SSI2  ♦  I2(I)*»2 

2448  SST  =  SST  ♦  T(I)«2 

2451  SUN! IT  =  SUMI IT  ♦  IKIUTd) 

2441  SUNI2T  =  SUNI2T  ♦  I2(I)»T(II 

2471  SMI1I2  *  SNI1I2  ♦  11(1X12(1) 

2488  38C0NTINUE 

2498C: ::::::::::::::::::::::::::::::::::::: 
2583C  DATA  CHECK  OPTION  SELECTION 

2518C:::::::::::::::::::::::::::::::::::::: 


:::::::::::::::::::::::::::::: 


::::::::::::::::::::::::::::::::: 


::::::::::::::::: 


2521  PRINT  35, DATAFILE 

2538  35  FORMAT (IX, "DO  »0U  KANT  TO  CHECK  DATA  AS  IT  IS  READ  FROM  FILE  ", 

2548  183  INPUT, ANSHERI2) 

2558  IF  (AHSWER(2).EO."NO">  CO  TO  II* 

2548  IF  (AN5WER(2).EQ."*ES"I  CO  TO  II* 

2571  PRINT,"  ANSWER  TES  OR  NO  ONLT  PLEASE* 

2558  PRINT,"  " 

2591  CO  TO  113 

248IC::::: ::::::::: ::::::: 

2418C  PREDICTIVE  AJILITT  TEST  OPTION  SELECTION 

242IC: ::::::  «i  ::t:it : :::::::::::  t:::  us:::  mm:: ::::::: ::::::  m :::::::: 


AND  CONVERTED  TO  L.  .'iHNS?",//l 


mciimmmmiitiiuim 


100 


2434  114  PRINT  41 

2644  44  FORMTUI.-W  tOU  NANI  A  COUP  ARISON  OF  THE  SHORTRAXCE  PREDICTIVE  ABILITY  OF  THE  TWO  MODELS?-.//* 

2454  145  INPUT i ANSWER (3) 

2444  IF  (AtiS»ER(3l.£8.“NO")  CO  TO  IM 
2474  IF  (ANSWER13)  .Efl.''TES")  CO  TO  243 

2484  PRINT."  ANSWER  TES  OR  NO  OHL1  PLEASE* 

2444  PRINT.*  " 

2744  CO  TO  145 

2714  243  PRINT  42 

2724  42  FORNAT(lI,"HOW  HANT  CASES  00  TOU  WISH  TO  TRUNCATE?*.//) 

2734  INPUT. ITRUNC 

. . Hiimmxismnmxuimismsmtimiuimx . . . . 

2754C  PROJECTION  AND  SENSITIV1TT  MATRIX  OPTION  SELECTION 

IT6»c:!:s>::ssssss:!i:::!::::ss:ss:s:ss!!  j:ss*s:::!:::»!s:ss*sjj!s  asjsiss  ssisssssiisTSSssJAAm*:!!:!*  jx* 

2774  144  PRINT  45 

27S4  45  FORMAT ( 1 X .“DO  TOU  WANT  PROJECTION  AND  SENSIT1VITT  MATRIX?*.//)  . 

2744  147  INPUT.  ANSWERU) 

2844  IF  ( ANSWER  U> .EO."NO")  CO  TO  148 

2314  IF  <ANSW£R(4I.Efl."TES">  CO  TO  148 

2824  PRINT."  ANSWER  TES  OR  NO  ONLT  PLEASE" 

2834  PRINT."  ? 

2844  CO  TO  147 

285JC! txxxixsxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxixxxixxxxsxxtxxxxxxixxxxxxxxtst 
2844C  BEGIN  DATA  CHECK  OPTION 

. . :::::::::: . . .  s  x :  s  s :::::  xsxs ::  s-.i :::::::  x  x ::  x  si ::  x  s  x :  s  x :  xxssx  t:s :: ! 

2oS4  148  IF  (ANSWER (2). EO. "NO")  CO  TO  14? 

2690  PRINT  Si»  DATAFILE 

29.4  54  rORNAT(lHl.//.75("»"). /. 51. "INPUT  DATA  AS  READ  FRON  FILE  '  AND  CONVERTED  TO  LOGARITHMS". 

29144  /.75I"»“)t 

2924  PRINT."  LINE  DIRECT  LABOR  HOURS  *  CUN  PROD  PLOT  POINT  •  .'SODUCTION  RATE* 

29:4  PRINT."  NUHEER  RATIONAL  LOCARITHH  »  RATIONAL  LOGARITHM  »  RATIONAL  LOCARITHR* 

2914  DO  44  I >t iNCASES 

2454  PRINT  55.LNII)iHRS(t!iT(I).PL0TU) iIl(I).RATE(t).X2(l) 

2964  55  F0RNATttI.il. I3.5I.F8.2.2I.P9.7,"  •  “.F8.2.2I.P9.7."  »  ".P8.2.2I.F9.7I 

2974  44C0NTINUE 

2984  PRINT  65 

2994  45  FORMAT  <U.75(“t")» 

3044  149  PRINT  74 

3414  74  FORMAT ( 1H1 > ISX) 

343JC 

3414C  PART  II  -  PEARSON  CORRELATION  COEFFICIENTS  AND  REGRESSION  ANALTSIS 
3454C 

SlUCMHWHiMHIHilMHHUlHIKmHIHmlimiHIIHHMttmmiKimimmimttHHHIHIH 


:xs:::xix:s:ss;s:s::sxsssxssxsssxxs:sssx:sx 


33E4C  CALCULATE  AND  PRINT  PEARSON  CORRELATION  COEFFICIENTS 
O890CX  s  :xx:xsssxs:::s:ssxssxsssxsssxsxs:::::s:ssxssssxssssssxsss 


SXSiXXSXXSISXSSXSXSXSXXSSXSXSSSXXSSXSSX 


101 


CA*& 


31 H  RIIT  *  (SUNIIT-SUHIl»SUHT/NCASESI/S8RT((SSIl-ISUHIt«Z/NCASESn»(SST-<SUHTii2/NCASES))) 

3111  RXZT  «  ISUHXZT-SUflX2*SU!TT/NCAS£S) /SQRT { (SSX2- <SUnX2*«2/MCASES) I • ISST- (SUHT*»Z/RCflSES) ) > 

3124  RXtXZ  >  (SHX l X2-SUf1X 1*3UMX2/NCAS£S) /SSRT < (SSX 1 - <SUnX 1 »>Z/NCASES1 )»<SSXZ- (SUMX2»*2/NCASE$>  > 1 

3131  RI1I1  >  1.1 

3144  RXZX2  >  1.1 

3151  RTT  >  1.1 

3144  PRINT  71tRTT >RXlT.RXZT>RXlTrRXlXI iRX lXZrRXZT >RX 1XZ>RXZXZ 

3171  71  FORHAKUi///. IX. 45("4“)./. 41. "PEARSON  CORRELATION  CCEFPICIEMTS  *. 

316K  "HATRir./.lI.45("A").//.4X."«".5I.T,.4l!"»"i5I.,,Il".5Ii',»*.5Ii 

3 1944  *I2*i/i1Ii45(“»“) »/»ZX.“T" .3X»3C*  ".F14.7.IX)./.lX.45lni"l./.2I. 

32461  *X1“,ZX.3<“*  “.Flf.7ilI)./.H.«5(*»")i/.2I*"I2".ZX.3("*  ".F14.7.1II.////I 

3Z10  PRINT  71 


3ZZt'C: :::::::::::::::::::::::::::::::::  :::::: 

3234C  CALCULATE  AND  PRINT  THE  RECESSION  RESULTS  OP  THE  STANDARD  LEARN  INC  CURVE  HODa 


3244C:: 


:: t i : 


j :: ;j  i : 


3Z54  81  =  <SUHX 1 T- ( (SU?«X l«SUHT  > /NCASESI ) / CSSX 1 - (SUBX 1 »*Z/NCASES>  > 

3 lit  TEAR  *  SUNT  INCASES 

3Z74  HRSBAR  >  SUNHRS/NCASES 

3Z£0  HEAR  >  SUHI1/NCASES 

3294  I22AR  >  SUHIZ/NCASES 

3344  34  *  TEAR-  8UI1BAR 

3311  AB4  *  14.HB1 

3321  PRINT  75 

3331  75  FORMT  ( 1 X 1 75(  “»")  i  / 1 1 41 1  "RESULTS  OF  THE  STANDARO  LEARNING"! 

33444  "  CURVE  NODEL" »/ » 1 X . 75 ("•“> . /.IX.1 “CASE" .3X » "OBSERVED" .5X » " 'PREDICTED"! 

33544  5X i "RESIDUAL" (5X t “Z  DEVIATION") 

3344  DO  114  I>1 iNCASES 
3374  TKATL  =  B4  *  31  »  11(1) 

3364  RESIDL  •  MI)  -  THATl 

33V4  SSEL1  >  SSEL1  ♦  RESIDL  ♦»  Z 

3444  SSTOL1  *  SSTOU  ♦  ITU)  -  TBAR)  »♦  2 

3414  THAT  >  14  H  THATL 

3424  RESID  *  HRS(I)  -  THAT 

3434  PERCENT*  (RESID  /  HRS(D)  »  144 

3444  SSE1  *  SSE1  ♦  RESID  ♦«  2 

3454  SSTOl  *  SSTOl  ♦  (HRS(l)  •  HRSBAR)  »»  2 

3444  PRINT  64iIiHRS(I)iTHAT.RESIDiPERCENT 

3474  64  FORMAT (tl i I3i4IiF8.Zi4IiF8.Zi5IiF8.2i7IiF4.Z1 

3484  114  CONTINUE 


102 


3599C  CALCULATE  AND  PRINT  STATISTICS  FOR  THE  STANDARD  LEARNING  CURVE  HOCEL 


3S1SC::i::::s:::::i: 


>  i  c  s :::  i :  > 


3529  NDFO  *  NCASES  -  2 

3539  THSRL  >  ISSTOL1  -  SSail 

3549  THSEL  *  SSEL1  /  NOFO 

3559  SEE  >  SORT  (THSEL) 

3549  VARB9  *  SEE  /  (1  /  NCASES  *  HEAR  <42  /  (SSXl  •  (SUKX1  «  2  /  NCASF.S))) 

3579  SE39  *  SORT  IVAR89) 

35S9  SEE!  >  SEE  /  (S3RT(SSIl-(SUMl»»2/NCASESm 

3599  RS5L1  *  (SSTOL1  -  SSEL1I  /  SSTCLl 

3499  RSOA1  >  ISSTOt-  SSE1)  /  SSTOt 

3419  FRATIO*  THSRL  /  THSEL 

3429  PLEARK*  (19  «  (81  <  AL0CI3(2.9I>)  <  199 

3439  PRINT  81, B9,SEB9,AB9.B1.SEBI,RS3L1, SEE, INSELpTHSRL, FRATIO, NOFD.RSOAl.PLEARN 
3449  81  FORHAT III* 75(,,<‘l)  ,/ , II > “THE  EQUATION  FOR  THIS  HODEL  IS!  ", 

34591  "  THAT  *  E9  <  11  «  B1",/,1I, 

3449A  "IN  LOC  FORK  THIS  "OOEL  BECOMES*  LOC(THAT)  *  L0CI89I  ♦  Bt  <  LOCUD", 

3478J  /.IITHHESE:  LOC(B0I  =",F8.5,4I,"STD  ERROR  *",F8.5,4I,"B9  *",FU.5> 

34899  /,13X."81  *",F8.5,4X,"$TD  ERROR  *",F8.5» 

34999  MX>"SUHKART  STATISTICS:"./,!!. 

37999  "R  SQUARES  LOC  *",F7.5,I0X,"$TD  ERROR  EST  »",Flt.4./,U. 

37199  “H$E",13X,‘=",F9.5>8I,"HSR",llX>“*“,F9.5>/,lX? 

37299  "F  RATIO", 91. "»“,F9. 4, 81. “0.  F.  (N/DI  *  !/M3./lIt 

37399  "R  SQUARED  ACTUAL*", F7.5, 81, “LEARNINC  FACTOR  *“,F9.S,“  PERCENT", 

37499  /,1I,75(“<")) 

3759  PRINT  79 


37490:::::: 


::::::: 


I! 


3770C  CALCULATE  AND  PRINT  THE  REGRESSION  RESULTS  FOR  THE  REDUCED  HRS  VS  RATE  HOCEL 

37&0C: i u :  t :::  j 

3799  B2  * (SUKI2T-I (SUK»2<SIJNT) /NCASESI I / (SSX2- (SUHI2i<2/NCASES) ) 

3899  E9  *  TEAR  -  B2  <  12EAR 
3319  AB9*  19  »  E9 

3821  PRINT  82 

3339  82  F0R"AT(IX>75("»"),/, 111, "RESULTS  OF  REGRESSION  ON  PRODUCTION", 

38*09  "  RATE  VARIABLE  ALONE",/, 11, 75("<") .MX,"CASE",3X,"0B$ERV£0",5I, 

38599  "PREDICTED", 51, "RESIDUAL", 51.“!  DEVIATION") 

3849  DO  tit  1*1, NCASES 

3079  THATL  *  B9  ♦  B2  *  12(11 

3889  RESIDE  *  Mil  -  THATL 

3899  SSEL2  <  SSEL2  ♦  RESIDE  «2 

3999  SST0L2  *  SST0L2  ♦  (Till  -  T9AR)  «  2 

3919  THAT  *  19  «  THATL 

3929  RESID  *  HRS(l)  -  THAT 

3939  PERCENT*  (RESIO  /  HRS(D)  <  199 

3949  SSE2  *  SSE2  ♦  RESID  «2 

3959  SST02  =  SST02  *  (HRS(I)  -  HRSBARI  «  2 

3949  PRINT  8J, I, HRS (I), THAT, RESID, PERCENT 

3979  III  CONTINUE 


' 

/V 
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3NB0C::::::  t 

3 990C  CALCULATE  AND  PRINT  STATISTICS  FOR  THE  REDUCED  HRS  VS  RATE  HO  DEL 

4I00C::::::  i 


4010  THSRL  *  4SSTOL2  -  SSEL2) 

4020  THSEL  *  ssa2  /  NDFD 

4030  SEE  =  SCAT  I  THSEL) 

4140  VARB0  *  SEE  /  II  /  NCASES  ♦  X2BAR  »»  2  /  ISSI2  -  (SUHI2  »♦  2  /  NCASES))) 
4050  SEED  *  SORT  (VARES) 

mi  SEB2  <  SEE  /  (SORT  (SSI2  -  (SUHI2  »♦  2  /  NCASES))) 

4070  RS0L2  *  ISSTCL2  -  SSEL2)  /  SSTOL2 

4080  RS0A2  =  (SST02-  SSE2)  /  SST02 

4090  FRATIO-  THSRL  /  THSEL 

4100  PRINT  93 1 ES f SEES > ABi i B2 1 SEE2 iRS0L2 . SEE i THSEL i THSRL .  FRAT 1 0 . NOFQ  > RSQA2 
4110  83  FORHAT(U,75("»“),/,lI."THE  EOUATION  FOR  THIS  HODEL  IS:  ", 

412ft  *  THAT  *  ES  »  12  M  B2",/.U 

41391  “IN  LCC  FORH  THIS  HODEL  BECOMES:  LOCIIHAT)  *  LOC(Ef)  ♦  B2  »  LOC1J2I*. 

41401  /,H,"HHERE:  LOCIE0)  *“.FB.5.4I,"STD  ERROR  »".F8.5.4Ii*‘B0  *",Flt.5, 

41501  />131>"E2  *“.F8.5,4I,"STD  ERROR  =*.F8.5, 

41401  /,tI,"SUKNART  STATISTICS:". I, [l, 

41701  "R  SQUARED  LOC  =".F7.5.tH.”ST3  ERROR  EST  ="iFll,4»/.Ut 

41S01  ■!i$E",l3I>"*“>F9.5,8Z."N$S,,,llX,"*“,F9.5,MI. 

41994  “F  RATIO". 91. “=n.F9. 4.81. “D.  F.  (M/D)  =  I/M3./.II. 

42001  “R  SQUARED  ACTUALS. F7.5./. II. 75l*»")l 

4210  PRINT  70 

4220C:::::: I:::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::: . ::::::: 

423SC  CALCULATE  AND  PRINT  THE  RECRESSION  RESULTS  FOR  THE  FULL  HODEL 

4240C ::::::::  ::s j  ::::::::::  s ::: s :::::::::: s :::::: s ::::::: s :::::::: s:: : 

4250  KWH  *  ttSSll-llBAR«S»m)«tSS12-12BAR»SUH12)  -  ISHm2-IlBAR*$UHI2)»«Z) 

4249  B1  =  ( (SSI2- I2BAK*SUNX2  U  ( SUHI 1 T  - 1 1  BAR  »SUHT )  - 

42701  ISH1112-I1BAR*SUHI2)KSUHI2T-I2EAR«SUHT))/DEN0H 

4289  B2  =  I(SSn-IlEAR»SUHII)  KSUJ1l2T-12BAR»SUItfl  - 

42901  (SMXlXZ-l  1BAR»SU*HX2)  *  (SUHX1T-X  1BAR-»SUMT> ) /DEMON 

43SS  BS  *  TBAR-B1 *11  EAR-32* I2BAR 


4310  AES  >  10.HE0 

4320  PRINT  84 

4330  84  FORMAT (1 X . 75 4 "»")./. 41 . "RESULTS  OF  COMBINED  CUMULATIVE  PRODUCTION*. 

43»0i  *  AND  PRODUCTION  PATE  HODEL"./. II. 75(,,»“),/, IX. "CASE", 31. "OBSERVED*. 51. 

43501  "PREDICTED", 5X,1 “RESIDUAL" .5X, "I  DEVIATION”) 

4340  DO  112  IM, NCASES 

4370  THATL  =  80  »  El  «  11(11  *  B2  »  1211) 

4380  RCSIDL-  TUI  -  THATL 

4390  SSEL  =  SSEL  *  RESIDL  »»  2 

4400  SSTOL  *  SSTOL  ♦  (Id)  -  TEAR)  ««  2 

4410  THAT  *  10  4»  THATL 

4420  RESID  =  HRS(I)  -  THAT 

4430  PERCENT*  IRESID  /  HRSII!)  »  100 

4410  SSE  *  SSE  ♦  RESID  «  2 

4450  SSTO  »  SSTO  ♦  (HRSdl  -  HRSBAR)  l»  2 

4440  PRINT  E0.I.KRSII), THAT. RESID, PERCENT 

4470  112  CONTINUE 


:::::::::::::::::: 

l :::::: : 


- 


104 


:::::::::::::: 


44B1C: 

4«9ec 

4511C: 

*511 

«SZ0 

*52iJ 

4S44 

4SS# 

J5t.it 

<571 

458* 

4591 

4611 

441# 

442# 

4431 

46*1 

4651 

4661 

4671 

4661 

46931 

47111 

47111 

47291 

47211 

47411 

47331 

47415 

47711 

4781 


it::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 

CALCULATE  AND  PRINT  STATISTICS  FOR  THE  FULL  HODEL 
::::::: :::::::::::::::: :::::: 

NDFO  *  NCASES  -  3 
THSRL  *  (SSTOL  -  SSEL)  /  2 
THSEL  *  SSa  /  NDFO 
SEE  •  SQRTlTHSai 
ZVAL  *  NCASES*  (SSI1  *  SSI2  -  SHI  1 12  >*  2)  -  SUHX1MSUHII  *  SSIZ  - 
SHX1I2  *  SUHI2)  *  SUHI2*($UHI1  «  Sill  112  -  SS11  «  SUNI2) 

AVAL  *  (SSI1  »  SSI2  -  SH11I2  *♦  21  /  ZVAL 
VARS1  »  THSEL  »  AVAL 
SE61  >  SORT  (VARS!) 

SEB1  *  SQRTI (THSEL  »  (SS12  -  I2BAR  ♦  SUHIZ))  /  OENOH) 

SEB2  =  SORT!  (THSEL  »  (SSI1  -  HEAR  »  SUilll) I  /  DEMON) 

RSQL  »  (SSTOL  -  SSEL)  /  SSTOL 
RSOA  *  (SSTO  -  SSE)  /  SSTO 
FRAT 10-  THSRL  /THSa 

FE1  =  (RSQL  -  RSQL2)  /  ((I  -  RSQL)  /  (NCASES  -  3)) 

FB2  *  (RSQL  -  RSQL1I  /  (d  -  RSQL)  /  (NCASES  -  31) 

PRINT  85, B1,SE28>AS9,B1,$EBI, FBI >B2,$EB2, FB'Z, RSQL, SEE, THSEL, THSRLiFRATtQiNOFOiRSQA 
85  FQRHAT (11,75 (“»“),/, U,“TKE  EQUATION  FOR  THIS  HOOEL  IS:  "t 
*  THAT  *  B!  *  XI  *♦  St  *  12  *»B2",/,1X. 

•IN  LOC  FORK  THIS  HOOEL  BECOMES:  LCC (THAT)  *  L0CIS1I  ♦  El  ♦  LOC(XI)  ♦  B2  »  L0C(I2)“, 
/, II, "WHERE:  LOC(Bl)  =“,FS.5,4X,"STD  ERROR  =“,F8.5,4I,"E!  =“,Ftl.5, 

;.131.”S1  **,F8.5,4I,"STD  ERROR  *",F8.5,4I,"F»  *",FI!.4,/r 
131. "B2  *",F8.5,4X,“STD  ERROR  =",FS.5,4I,"F*  =“,F1M,/,1I, 

“SUHHSRT  STATISTICS:", /,!X,"R  SQUARED  LOC  =“.F7.5»1#X. 

“STD  ERROR  EST  *“,F11.4,/,IX,"HSE",t3X,"*",F9.5i8I,"HSR“im,"*",F9.5>MX, 

“F  RATIO", 91. "*",F9.4,8X,"D.  F.  (N/D)  =  2/". 13./. II. 

"R  SQUARED  ACTUAL^" ,F7 .5. / . 1 I .75 ( ■*“) ) 

PRINT  71 


4791C** I*********************************** *♦»»♦**»*******»**•*»***»*»****♦♦****»*♦** *»*****»****»*♦♦*♦*» 

46MC 

4 StfC  PART  III  -  PREDICTIVE  AEILITT  TEST  OPTION 
4821C 


4831C******** ********** ******************************* ******* **************** to**************** * ******** 

464!  IF  IAH$UER(3).EQ.“N0")  CO  TO  116 
495!  DO  113  1*1 .  ITRUHC 

4S61  I  TEST  *  NCASES  *1-1 

4871  PRINT  84> I  TEST ,HRS ( ITEST) 

438!  66  FORMAT ( 1 1. 1 14 ("*“),/,  1 1 ,"*“.371 . "SHORTRANCE  PREDICTIVE  ABILITT  ", 

46914  “COMPARISON".  37X, II, "*M4Xi 

49111  “THE  DATA  PRESENTED  BELOU  IS  FOR  CASE  l",I3.“  WHICH  HAS  AN  OBSERVED", 

49111  “  VALUE  OF:*, F9.2, III, “*",/, 

49211  1I.116("»“I , /n>"»" >31, “f", 31 »"*". 91, "REDUCED  (LEA5NINC  CURVE)  ", 

49311  "HODEL" ,81 , “**" ,31 , "FULL  (CUMULATIVE  PROCUCTION  t  PRODUCTION  RATE)  ", 

49411  “HODEL". 21. II,"*","  CASES  ",I18("»"),/,1I,"«  USED  *  ", 

49511  "PREDICTION  *  I  DEVIATION  ♦  EST  P!  •  EST  SI  »*  “, 

49611  “PREDICTION  ♦  X  DEVIATION  »  EST  B 1  »  EST  Bl  *  EST  82  »", 

49712  / , 1 X , 1 16 ( “*“)  1 

498!  DO  114  3*1 , ITRUHC 


\ 


105 


>  * 


4991 

ICASES 

»  ITEST  -  J 

SOI! 

sum 

■  1 

sunn 

>  1 

5121 

sunn 

<  1 

5132 

SSJt 

>  1 

3241 

SSI2 

<  1 

S23I 

sunm 

*  9 

3142 

SUHI2T 

«  1 

3271 

snnn 

>  1 

3182 

BO  115  KM. ICASES 

5092 

SUHT 

*  sum  ♦  mo 

Sill 

sunn 

*  sunn  ♦  n  (ki 

Sill 

sum  2 

>  sunn  *  nixi 

3121 

SSI! 

*  SSll  *  IlIK)  «  2 

5131 

SSI2 

=  SSI2  ♦  X2(X)  h  2 

5141 

sunnr 

« sunm  ♦  IKK)  »  TIK) 

5152 

sunm 

--  SUMX2T  *  X2(K)  •  TIK) 

5141 

snnn 

*  snnn  ♦  xkki  *  niKi 

5171 

115  CONTINUE 

5181 

ICOUNTA 

>  ICOUNTA  ♦  1 

3181 

TEAR  : 

sum  /  [CASES 

5212 

11  BAR  = 

sunn  /  icases 

3211 

I2BAR  = 

sunn  /  icases 

5221 

B1R  = 

(sunm  -  Ksunn  *  sun 

5232 

m  = 

TEAR  -  SIR  »  HEAR 

5241 

ABIR  = 

12  a  EIR 

ISUAI1  »»  2  /  [CASES)) 


THATR  *  II  a  (BIS  ♦  BIS  »  IKITEST)) 

BEVR  *  HRS1ITEST)  -  THATR 
ADEVRI  ICOUNTA)  >  ABSIOEVR) 

SUNAOEVR  =  SUNAOEVR  *  AOEVR(ICOUNTA) 

PBEVR  >  112  *  OEVR/HRSUTEST) 

APOEVR  =  ABS(PCEVR) 

IF  (APBEVR.Cr.ll.il  CO  TO  211 
ICOURTCR  «  ICCUNTCR  ♦  t 
IF  (APDEVR.CT.5.1)  CO  TO  211 
[COUNTER  =  [COUNTER  ♦  I 

221  BENCH  =  USSlt-llBAR»$lRHm($S«2-UBAR»SUIK2>  -  (SHm2-IlBARiSUNI2)«2) 
BtF  *  ( (SSX2-X25AR*£UNX2) * (SUNXl T-I lBAR*SUHf >  - 

(SRm2-U5AR»SUM2>»<SUM2M2EPR»Smm/OEHOIt 
B2F  =  {(S£Tl-XlEAR*StJHXl)*(SUMT2T-X2BAR«SUNT)  - 

($IHlI2-Jl»AR»SUI1X2M(SUimr-MAR»SUinl)/0ENail 
BIF  =  TEAS  -  B1F  *  XI3AR  -  B2F  ♦  I2BAR 
ABIF  *  II  M  BIF 

THATF  >  II  »»  (BIF  +  BIF  «  ll(ITEST)  ♦  B2F  ♦  12 (I TEST) I 
DEVF  =  HRS  1 1  TEST)  -  THATF 
ABEVF(ICG'ONTA)  =  SBS(DEVF) 

SUHAOEVF  =  SUHAOEVF  ♦  AOEVFI ICOUNTA) 

PBEVF  *  111  »  CEVF/HR$<ITEST) 

APDEVF  =  ABS (PBEVF) 

IF  (APBEVF.CT.H.I)  CO  TO  212 
ICOUNTCF  =  ICOUHTCF  ♦  1 
IF  (APBEVF.CT.S.I)  CO  TO  212 
ICOUNTE"  *  I  COUNTER  ♦  I 

202  PRUT  87»ICASES*THATR?PDEVRiABISiBlRiTHATFfPDEVFiABIFfB)F.82F 
87  FORMAT  III »“»“i2I> 13.21 11 >F9.2>2I."»”.3IiF4.2t 41 i"*,iF9.2i1I» 
“»,'tF8.5illi"**''ilIiF9.2i2[i"»Mi3I>F4.2f4If"*"iF9.2iIIi"*"iF8.5ilIi 
M",F8.5*tli"A") 


_  Is  ;T  ^JALIIT  P2U&JKABVS 

■ «.  1  *  ;  K)  DOC  _ _ 


l 


114  CONTINUE 
PRINT  83 

88  FflS:<AT(U,tlS<N"),//////l 
COUNT  *  COUNT  ♦  1.1 
aPCl  »  COUNT  /  2.3 
FLAC2  »  FUC1  -  INT(FLACl) 

IF  tFUC2.NE.MI  CO  TO  113 
PRINT  73 
113  CONTINUE 

AVGADEVR  =  SUNAOEVR  /  ICOUNTA 
AVCAOEVF  *  SUHADEVF  /  ICOUNTA 
DO  11?  I  =1.  ICOUNTA 
SSDEVR  =  SSDEVR  *  lADEVPtl)  - 
SSDEVF  =  SSDEVF  ♦  (ACEVFII)  - 
119  CONTINUE 


AVGADEVR) »*2 
AVCAOEVF) «»2 


CALCULATE  AND  PRINT  RESULTS  SUHHART  FOR  PREDICTIVE  ABILITY  TESTS 

VARADEVR  »  SSDEVR  /  (ICOUNTA  -  1) 

VAP.ADEVF  =  SSDEVF  /  (ICOUNTA  -  I) 

TESTSTAT  =  ( AVGADEVR- AVCAOEVF) /SORT ( (VARADEVR/ ICOUNTAI ♦ (VARAOEVF/ ICOUNTA) I 

PCENTER  =  133  4  ICOUNTER  /  ICOUNTA 

PCENTCR  =  138  *  ICOUMTCR  /  ICOUNTA 

PCENTEF  =  133  4  ICOUNTEF  /  ICOUNTA 

PCENTCF  --  103  4  ICOUNTCF  /  ICOUNTA 

PRINT  95 iftVCAuEVR, AVCAOEVF i VARADEVR iVARADEVF iTESTSTAT i ICOUNTAi 
ICOUNTA, ICOUNTcR.ICOUNTEF, PCENTER, PCENTEF. ICOUMTCR. ICOUNTCF. PCENTCR* 
PCENTCF 

95  PORNAT ( 1 1 >47 (“4") , / , 11 , "»" , 131, "SUMNARt  QF  PREDICTIVE  ABILITY  TESTS" t 
"  RESULTS". I2Xr II, 47("4"I,/,U, 9X. "ITEPIS  OF  INTEREST". 81. 

"»  REDUCED  MODEL  *  FULL  MODEL  »*,/,U.47<“4"),Ml,»i  AVERAGE  ", 
“ABSGLUTc  DEVIATION" ,7X . “#,,,3X .F9.2.3X , »F9. Z ,3X, "»“ ./» IX, 

"4  VARIANCE  OF  ABSOLUTE  DEVIATIONS", 2X, "»“, II, Fit. 2, 31, “*",F1I. 2,314 
II, “»  TEST  STATISTIC  (SEE  NOTE)", «."»■,«*' 4I,"»“, 21, 

F9. 2,31, II, “*  TOTAL  NUMBER  OF  TEST  SITUATIONS  *“ ,6X . I3.6X. 

51.13. 81,  “»*,/, II, “»  NUMBER  OF  PREDICTIONS -WITHIN  51  i", 41,13.81, 
,'4",5I,I3,8I,,'4",/,H,"4  PERCENT  OF  PREDICTIONS  WITHIN  51  ♦".4l,F4.lf 
5I»“*">5X>r4.0>5X,“*“>/,U,"»  NUMBER  OF  PREDICTIONS  WITHIN  101 

41. 13. 81,  "i“, 51,13.81, "4“./, II, “»  PERCENT  OF  PREDICTIONS  WITHIH  l»l»“, 
4X,P4.9,5I,“*',,5I,F4.3,5I,“»l,,/,II,47C'»"),/iH,“N0TE!  IN  TESTINC  FOR  ", 
“STATISTICAL  SIGNIFICANCE  USE  STUDENT’S  T  DISTRIBUTION",/, II 

“IF  THE  NUINEER  QF  TEST  SITUATIONS  ARE  LESS  THAN  88)  OTHERWISE  ", 

"USE  STANDARD",/, II, "NORMAL  DISTRIBUTION.  IN  EITHER  CASE  THIS  IS 
“A  OLE  TAILED  TEST.  IF",/, II, "THE  TEST  STATISTIC  IS  GREATER  THAN  *, 

"THE  CRITICAL  STATISTIC  ONE  NAT",/, 11, "CONCLUDE  THAT  THE  AVERACE  “, 
■ABSOLUTE  DEVIATION  OBTAINED  WITH  THE  FULL", /.II, "MODEL  IS  ", 
“SICNIFICAHTLT  LESS  THAN  THAT  OBTAINED  WITH  THE  REDUCED  MODEL.") 
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4#4#C 

t»5flC  PART  IV  -  PROJECTION  AND  SENSITIVITT  MATRIX  OPTION 
4I42C 

illKlIHWmmiHHIHIIHIIHHHIHIMWilHHIiHOMmHWIHHHHIIIUHIIiMIHMillWIH 
4»8i  114  IF  (ANSWER (4) . EO. "NO")  CO  TO  US 
4#9#  ADDPLOT  =  PLQTINCASES) 

4111  PRINT  70 

411#  00  117  [>t,lf» 

(U#  ADDBL0T  =  ADDPLOT  ♦  .01  ♦  PLOT  INCASES) 

413#  NENPLOTII)  *  INT(AOOPLOT) 

414#  ADORATE  «  .4#  ♦  RATE  INCASES) 

415J  DO  116  J*t,9 

414#  ADORATE  *  ADORATE  ♦  .1  ♦  RATEINCASES) 

417#  PRORATE 1J)  *  ADORATE 

418#  FHRSIIiJI  *  AS#  »  N£VPL0T(ll«81  *  PRORATE (J)«82 

419#  118  CONTINUE 

42##  117  CONTINUE 

471#  ISTART  »  1 

423#  ISTOP  =  5# 

423#  DO  12#  K»l,2 

424#  PRINT  89,(PR0RATE(J),J=I,9) 

425#  S9  FORMAT ( U , l 13 (“»“),/, II >"»", 391 , “PROJECTION  AND  SENSITIVITT  HATRII", 

Utit  391, "#",/, IX, 113 (”»"),/, IX, “»  PROJECTED  *“ r34X. "PROJECTED  PRODUCTION". 

4I7W  “  RATES“>34I>“»“,/>1I,"»  CUMULATIVE  99 (“*")./, 1 X , UNITS 

42S04  9(F8.2»2X, "»")./, II, U3<"»‘») 

429#  DO  121  I = [START, [STOP 

43##  PRINT  9«.NEWUJTUMn'RSU,J),J--l,9> 

431#  9#  rORHAT(IX,"»''i3X,I4i3X>"*“,9(lI>F8.1,lX>l,»")) 

432#  121  CONTINUE 
433#  PRINT  91 

434#  91  F0RMAT(lX,ll3("t")) 

43S#  PRINT92 

434#  92  FORMAT (II, -NOTE:  1.  PROJECTED  VALUES  FOR  DIRECT  LABOR  HOURS  HAT  ", 

43784  'BE  READ  FROH  THE  ABOVE  MATRIX  BT  HATCHING  A  GIVEN  PRODUCTION" ,/. IX, 

43324  "RATE  UITH  A  GIVEN  NUMBER  OF  CUMULATIVE  UNITS  AND  READING  THE  ", 

439##  "VALUE  FOR  DIRECT  LABOR  HOURS  FOUND  AT  THE  INTERSECTION",/, II, 

44##i  "OF  THE  CCRtSFC'iDINC  ROM  AND  COLUMN.  FORECASTING  MODEL  IS  THE  ", 

441##  "CUMULATIVE  PRODUCTION  t  PRODUCTION  RATE  MODEL.",/, 71, "2.  PROJECT', 

442!#  "ION  INTERVAL  FOR  CUMULATIVE  UNITS  IS  II  OF  THE  LAST  OBSERVED  VALUE", 

44384  "  OF  CUMULATIVE  UNITS.",/, 71, "3.  PRCJECTIOM  VALUES  FOR  PRODUCTION  ", 

44<#4  "RATE  ARE  7#,  81,  9#,  1#«,  11#,  12#,  13#,  14#,  AND  IS#  PERCENT  OF  ", 

44504  "THE",/, II. "LAST  OBSERVED  VALUE  OF  PRODUCTION  RATE.") 

444#  ISTART  >  Si 

447#  ISTOP  >  l#i 

443#  PRINT  7# 

449#  12#  CONTINUE 
45##  125  STOP 
4510  END 


V 
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